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PREFACE 



The Stages of Concern About the Innovation Questionnaire is the result of 
three and cne-half years of research and development, including extensive study 
of individuals involved in "change" in both schools and universities. Based on 
teacher concerns research conducted by Prances Fuller in the 1960's, Stages of 
Concern are a primary dimension of the Concerns-Based Adoption Model, a model 
developed at the Texas R&D Center to conceptualize and facilitate educational 
change. The Stages of Concern Questionnaire (SoCQ) was developed to assess the 
seven hypothesized Stages of Concern About the Innovation. The final form of 
the SoCQ presented in this manual has been used in cro3s-sectional and/or longi- 
tudinal studies of eleven process and product innovations. Based on data from 
these studies, the existence of Stages of Concern and the usefulness of the SoC 
Questionnaire have been confirmed. 

This manual has been designed to serve the needs of researchers, facilita- 
tors of change, and others \riio would like to use the SoC Questionnaire. It is 
both a user's manual and a technical report of the development of the measure. 
In it, we provide both psychometric and interpretative information about the SoCQ. 
We begin by defining concerns, describing the questionnaire, and presenting re- 
liability and validity information. Administration and scoring sections follow. 
Nearly half of the manual is devoted to interpretation — from the siioplest in- 
terpretation based on identification of highest Stage of Concern to the most 
complex interpretation based on SoC profiles and individual item responses. The 
manual text concludes with a statement of limitations and restrictions. The 
complete SoC Questionnaire, including optional pages, is included in the Appendix. 
Program listings and sample data for coinniter processing are also included as ap- 
pendices. 

For those who prefer a less q\aantitative and technical assessment of Stages 
of Concern About the Innovation, an alternative to the SoCQ is available. In 
another publication, A Manual for Assessing Open-Ended Statements of Concern 
About the Innovation (Austin: Reseeurch and Development Center for Teacher Educa- 
tion, The University of Texas, 1976) by Beulah Mewlove and Gene Hall, an open- 
ended procedure for assessing concerns of innovation users and nonusers is de- 
scribed. The open-ended form is especially suited to more open-ended assessments 
of concerns and does not require quantitative scoring procedures. 

For more information about the SoCQ, the open-ended SoC measure, or other 
aspects of our research, please feel free to contact ns. We would also liice to 
know about the research activities and findings of others who have used the 
measures, tools, or concepts which we have developed as a part of o\ir studies of 
change and our initial verification of the Concerns-Based Adoption Model. 
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SECTION I. 



BACKGROUND: CONCERNS THEORY AND RESEARCH 



Research in the area of concerns about innovations is an oux:growth of pio- 
neerii\g research by Prances Fuller in the area she named "teacher concerns." In 
this section, the previous research in this area is briefly reviewed, including 
references to the principal papers by Fuller. The Concerns-Based Adoption Model 
is introduced, briefly described, and the concept of concerns is discussed. 
Stages of Concern About the Innovation cu:e then introduced and defined, and the 
section ends with a brief treatment of arousal and resolution of concerns. 

Previous Reseaurch on Teachers' Concerns 

The problems and satisfactions of student teachers and inservice teachers 
have been the subject of many studies. In 1932, Margaret Phillips reported on 
"Some Problems of Adjustment in the Early Years of a teacher's Life" in the 
British Journal of Educational Psychology, since then, many other researchers 
have analyzed the problems of teachers, with a number of studies focusing on the ' 
"anxieties" of student teachers. 

Thompson (1963) asked 125 student teachers near the end of student teaching 
to respond to a 35-item checklist of particular types of anxieties. The stu- 
dents were asked to indicate which anxieties had been experienced, to report 
^Aether the anxiety occurred before or during student teaching, and to identify 
V the source of tht^ anxiety. Thompson defined anxiety as Sawrey and Telford (1959) 
Nyhad: "Anxiety is a mixture of fear, apprehension, and hope referred to the 
^uS;^[re^" Elsewhere in his paper, Thompson equated anxiety with "questions, prob- 
lems ,^nd worries [experienced] during their [student teacher] preparation." 

Travers, Rabinowitz, and Neroovicher (1952) administered a 21- item sentence 
completion test to 120 elementary student teachers at the beginning and end of 
a semester student teaching course. Three of the 21 items were analyzed to de- 
velop categories for the organization of responses^ Anxiety of student teachers 
was again the focus. ".* .Anxieties upon %rtiich this study is focused are those 
induced by or attended to teaching circumstances.... anxiety is an extremely un- 
pleasant experience chauracterized by vague feelings of discomfort and tension." 
Their data showed that "the student teachers were most anxious in relation to 
the problem of discipline." Additionally, "Another major source of anxiety is 
related to the matter of ^Aether the pupils will like the stxident as a teacher." 
These authors viewed anxiety about discipline as being "somewhat discouraging" 
in light of "modem educational theory," and they suggested that teacher train- 
ing had fallen short since discipline was the major concern of student teachers. 

As part of a large-scale (N » 736) , two-phase study of the "factors causing 
strain in teaching and on the Motional problems which beset the teacher in 
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ceurrying on his dutier/' Gabriel (1957) collected data on the problems and sat- 
isfactions of experienced emd beginning teachers. His book provides a wealth of 
data and analyses about the stresses and strains on teachers and their relation- 
ship^ to othet variables. Among the findings are those abstracted by Fuller 
(1969) in Figure 1.1 vAiich show that problems and satisfactions differ signifi- 
cantly between experienced and inexperienced teachers. 



Figure I.l. Concerns of Experienced vs. Inexperienced ^Teachers in England 

* 

Who is More Concerned? P 



Problems : 

Criticism from .iuperiors 
Maintaining discipline 
Slow progress of pupils 



Satisfactions: 

Prais^-f^oS" inspectors 
Holidays 

Success of former pupils 



Inexperienced 
Inexperienced 
Experienced 

Inexperienced 
Inexperienced 
Experienced 



.01 
.01 
.05 

.01 
.01 
.01 



Source: Adapted from John Gabriel's EmotiiMal Problems of the' 
Teacher :.n the Classrooia (London & New Zealand: Angus & Robert- 
son, Ltd., 1957) /pp. 197-1997\ 



Frances FxiLler, during the mid- axid lc«te-1960's, pursued a series of in- 
depth studies of the "concerns" of teacherri. A counseling psychologist, Fuller 
approached her studies from a clinical rather than a pedagogical point of view. 
Based on a series of group counseling sessions and longituc^inal in-depth inter- 
views of student teachers. Fuller (1969) proposed a developmental conceptualiza- 
tion of the conoerns of teachers. 

The literature provided an independent set of studies under various headings, 
such /as problems and anxieties of teachers, that, when combined with Fuller's 
clinical assessments, provided a grounded basis for characterizing the v2u:ious 
kinds of conoerviS of preservice and inservice teachers. Further, ii: api>eared 
that concerns occxir in a natural sequence and are not simply a direct consequence 
of the quality of a particul£u: teacher education program. 
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Fuller (1969) proposed three phases of concern: a pre-teaching phase, an 
earJr teaching phase, and a late teaching phase: 



I Pr«-Te^ciiinrT ?hH.:e: Non-Concern 

"These stadents rarely had specific concerns related 
to t^ching itself. The teaching-related concerns 
they aid express were usually amorphoas and vagme: 
anticipation or apprnahenpicn. . . . This pro-teaching 
period seemed to be a period of non-concem with the 
specifics of teaching, or at let.st a period of rela- 
tively low involvement in teaching" (p. 219). 

Early Teaching Phase: Concern with Self 

This phase consists of a set of dovert Concerns: 
Where Do I Stand? and a set of Overt Concerns: How 
Adequate .'"i 7 These concerns are most frequent 
with student teachers and beginning teachers. The 
"Where Do I £-and?" concerns are reflected in teachers 
trying to estimate how much support they will have 
from their siflpervising teacher and the principal and 
the limits of their acceptance as professional persons 
within the school. The overt "How Adequate Am I?" 
concerns deal with class control and the larger con- 
cern of general adequacy and preparedness to handle 
the classroom situation. ^ 

Late Concerns: Concern with Pupils 

These concerns axe characteristic of experienced, 
^ superior teachers. Concerns focu^ on pupil learning 
and teacher professional development. 

By the end of the 1960's, the "concemt^ model" was||bstracted to "self," 
"task," and "impact" concerns with the "impact" concernsBfeing sub-divided into 
several levels, in 1^0, Fuller proposed .a model for personalized teacher educa- 
tion, "Personalized Education for Teachers, An Introduction for Teacher Educators, 
based on the concerns 6i teachers^, and further pursued research into the dynaiaics 
^ of teachers' concerns (Puller, Parsons, & Watkins, 1973), and their assessment, 
arousal, and resolution (Fuller f:^ Manning, 1972; Puller & Bown, 1975). This pio- 
neering work on concerns of teachers served as the basis for developtient of the 
Stages of Concern About the Innovation dimension cf the Concerns-Based Adoption 
Model. 

The Concerns-Based Adoption Model 

In the 1969-70 academic year, staff members of the Inter-Institutional Pro- 
gram of the Research and Development Center for Teacher Education observed that 
teachers and professors involved in change appeared to express concerns" about' 
iiinovaVions that were quite similar to those \A\ich Fuller had identified with 
teachers abo\xt their teaching. Procediires were set up for documenting the con- 
cerns expressed by adopters of various educational innovations. Qualitative data 
ytaa collected as part uf the on-qoing field work of the Inter-Institutional staff 
for the neA*t three years. 
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As the Center's product and process innovations were adopted by mere and 
more teacher educators, the Inter-Institutional Program staff began to hypothe- 
size that there were definite categories of innovation adopter concerns and that 
these concerns changed in what seemed to be. a logical progression as users be- 
came increasingly skilled in using the innovation. In time, seven Stages of 
Concern ^bout the Innovation (SoC) tentatively were identified. Stages of Con- 
cern About the Innovation then served as one of two basic dimensions for de- 
scribing the dynamics of an individual innovation adopter. 

The second dimension, Levels of Use of the Innovati ^ '^x^U) , focuses on 
knowledge, skilly and behavioral aspects of the indi' involvenient with a 

change. Levels of Use as a variable has been opera xiy defined (Hall, Loucks,' 
Rutherford, & New love, 1975) and a specially designed focused interview proce- 
dure has been developed to meastire it (Loucks, Newlove, & Hall, 1976). 

In combii*ction, SoC and LoU provide a powerful description of the dynamics 
of an individual involved in change, one dimension focusing on feelings, the 
other on performance. Each member of a formal orgaui'^zation/ such as a school or 
college, will have herAis own Stage of Concern about and Level of Use of a par- 
ticulcu: ii>novation. 

Understanding and describing the process of change in educational institu- 
tions, while at the same time maintainina sight pf the individual, is a chaj.- 
lenging task for managers, of the change process, as well as for change research- 
ers. Ba3^d on die hypothesized Stages of Concern and Levels of Use, researchers 
at the OTR&D Cdter developecL a model of the complex ptwess of change as oc- 
curs through the adoption of innovations by individuals within formal organiza- 
tions. This model, the Concerns -Based Adoption Model (CBAM) was first conceptu- 
alized by Hall, Wallace., and Dossett in 1973 in the "original CBAM paper." In 
it, the authors proposed that SoC and LoU could be used as diagnostic tools for 
eissessing Wiiere the individual members of an organisation are in relation to the 
adoption of an innovation. The CBAM further proposes that the manager of a spec- 
ified change could then use these diagnostic data in developing a prescription 
for needed interventions to facilitate the change effort. 



The Concept of Concerns about Innovations 

The world around us is complex. It is not humanly possibi . to focus at any 
one time on all of the many different stimuli and conditions surrounding us. 
There is much that we do net perceive at all. Of all that we do perceive, we 
are not equally attentive to each peurt. Each component, and each element indi- 
vidually and in vatrious combinations are of different interest and priority, 
with most being of little or no interest at any given time. 

However, certain aspects of our world are of higher priority. Some appear 
to leap out at us, demanding our attention. The way we perceive these things 
is dependent on the unique and multifaceteJ person that each of us is, as well 



^ This section is part of a concept paper in draft by Gene E. Hall, Research 
and Development Center foi Teacher Education, the University of Texas at Austin, 
Summer 1976. 
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as the characteristics of the issue, idea, or thing that is the center of atten- 
tion. Our past history, personality dynamics, motivations, needs, feelings, edu- 
cation, roles, status, our entire social-psycho being in relation to our experi- 
ences and knowledge shape how we perceive cind, in our minds, .contend with the 
issue, object, or problem at hand. The reason for attention to be focused on a 
particular issue may be external, influenced by others, by a thing or an idea; 
or the dem2uids may be internal, coming from within oi:u:selves; or there may be a 
combination of internal and external stimuli at work. 

The composite representation of the feelings, preoccupation, thought, and 
consideration given to a particular issue or task is called concern. Depending 
on our personal make-up, knowledge, and exp riences, each person perceives and 
mentally contends with a given issue differently; thus there are different kinds 
of conceras. The issue may be interpreted as an outside threat to one's well- 
being, or it may be seen as rewarding. There may be an overwhelming feeling of 
confusion and lack of information about what "it" is. There may be ruminations 
about the effects. The demand to consider the issue may be self-imposed in the 
form of a goal or objective that we wish to reach, or the pressure that results 
in increased attention to the issue may be external. In response to the demand, 
our minds explore ways, means, potential barriers, possible actions, risks, and 
rewards in relation to the demamd. All in all, the menc::l activity composed of 
-questioning, analyzing, and re- analyzing, considering alternative actions and 
reactions, and anticipating consequences is concern. An' aroused state of per- 
sonal feelings and thought about a demand as it is perceived is concern. 

To be concerned means to be In a mentally aroused state about something. 
The intensity of the atrousal will depend on the person's past experiences and as- 
sociations with the siibject of the arousal, as well as how close to the person 
and how immediate the issue is perceived as being. Close personal involvement 
is likely to mean mere intense (i.e., more highly aroused) concern which will oe 
reflected in greatly increased mental activity, thought, worry, analysis, and 
anticipation. Through all of this, it is the person's perceptions that stimulate 
concerns, not necessarily the reality of the situation. 

In working with individuals involved in change, staf^ at the UTR&D Center 
have found concerns about the change to be an important dimension of the process. 
In this research, the generic name given to the issue, object, problem, or chal- 
lenge, the tltLng that is the focus of the concerns, is innovation. The innova- 
tion and its use provide a frame of reference from which concerns can be viewed 
and described. 

Depending on one's closeness to and involvement with an innovation, one's 
concerns will be different in type as well as in intensity. Many ty^s, or 
leve«^, of concerns can be experienced concurrently; however, there are normally 
differential degrees of eurousal. With each putson, certain demands of the inno- 
vation are per6eived as being more important than others at a given time. Thus, 
the degree of arousal (intensity) .of the different types of concern will vary. 
Concerns will vary depending on the amount of one's knowledge about and experi- 
ence with the innovation. Use and xrontise make a difference; whether the innova- 
tXon might be used sotaetime in the flbture, direct involvement with it hew^^ust 
begun, or the person is highly expeifieticed with the innovation will likely^m^an 
that different types of concern are more intense. In addition, there appears"\ 
to ? e a predictable pattern to the movement of intensity of concern across typesk 
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Stager of Concern About the Innovation 

Different "stages oc concern about the innovation" have beer* identified. 
It appears that there is developmental movement through these stages; that is, 
certain types of concern will be more intense, then less intense, before arousal 
of other types will occ\ir, thus the name "stages." As in Fuller's work with 
teachers' concerns about teaching, stages of concern eJ^out an Innovation apprar 
to develop from early unrelated, to self, to task, and finally to impact concerns. 
Seven different Stages of Concern About an Innovation have been defined in Figure 
1.2. These stage definitions provide the conceptual basis for development of 
the SoC Questionnaire and interpretation of its data. 



The Arousal and Resolution of Concerns 

Concerns about innovations appear to be develofmiental in that eulier con- 
cerns must first be resolved (lowered in intensity) before later concerns emerge 
(increase in intensity) . The research suggests that this developmental pattern 
holds for most process cuid product innovations. 

As Fuller pointed out, aurousal and resolution of concerns require quite 
different inputs: 

"Arousal seems to occur during affective experiences — for 
example , during confrontation with one * s own video tape .... 
Resolution seems tc occur through more cognitive experiences: 
acquisicion of informatfion, practice, evaluation, synthesis 
and so on" (1970, p. 11). 

However, resolution of earlier concerns and the eurousal of later concerns are 
nc^ accompJ.ished simply by having more knowledge about or time and experience 
with the innovation. Many other factors influence concerns as well. For exan^le, 
the innovation may be basically a bad one. The knowledge and skill requirements 
may be beyond the person's cap2d>ilities. Or other demands on the person may 
prohibit the innovation from having a high priority in the person's life space. 
In any case, the process of the arousal and resolution of concerns is highly 
personal and requires time as well as timely intervention of both cognitive and 
affective natxires. Highly intense concerns may not be easily reduced, 2Lnd in 
some cases a person's history, dynamics, and capabilities may make resolution of 
certain concerns nearly iit^ssible. In general, however, it appears that a per- 
son's concerns about an innovation develop toward the later stages (i.e., toward 
Impact concerns) with time, successful experience, and the acquisition of new 
knowledge and skill. 

It is critical to note that higher level concerns development cannot simply 
be engineered by an outside egent. Holding concerns and changing concerns is a 
dynamic of th^ individual. The timely provision of affective experiences and 
cognitive resources can provide the grist for concerns arousal and resolution, 
thereby facilitating the development of higher level concerns. But there is no 
guarantee that 2u:ou8al of higher stage concemis will follow the reduction of 
lower stage concerns. Providing inputs that are not stage relevant (e.g., at- 
tempting to force high level concerns) is an assured way to increase the inten- 
sity of lower stage concerns. Whether and with what speed higher level concerns 
develop will depehd on the person as well as the Innovation and the environmental 



ERiC 



15 



7 



Figure 1.2 Stages of Concern About the Innovation 

0 A^RENESS I Little concern about or involvement with the innovation is indi- 
cated. 

1 INFORMATIONAL i A general a^vareness of the innovation and interest in learn- 
ing more detail about ir is indicated. The person seems to be unviorried 

^ about herself/himself in relation to the ijinovation. She/he is interested 
in substantive aspects of the innovation in a selfless manner such as general 
characteristics, effects, and requirements for use. 



2 PERXNAL i Individual is uncertain about the demands of the innovation, her/ 
his inadequacy to meet those demands, and her/his role with the innovation. 
This includes analysis of her/his role in relation to the reward structure 
of the organization, decision making, and consideration of potential con- 
flicts with existing structijres or personal commitment. Financial or status 
implications of the program for self and colleagues may also be reflected. 

3 MANAGEMENT I Attention is fociised on the processes and tasks of using the 
innovation auid the best use of information and resources. Issues related to 
efficiency, organizing, managing, scheduling, and time danands are utmost. 



4 CONCEQUENCE t Attention focuses on impact of the ixmovation on students in 
her/his immediate stphere of influence. The focus is on relevance of the in- 
novation for students, evaluation of student outcomes, including performance 
and competencies, and changes needed to increase student outcomes. 

5 CX)LLABOEATION \ The focus is on coordination and cooperation with others re- 
garding use of the innovation. 



6 REFOCUSING ; The focus is on exploration of more universal benefits from the 
innovation, including the possibi^lity of major changes or replac«nent with a 
more powerful alternative. Individual has definite ideas about alternatives 
to the proposed or existing form of the ixmovation. 



Original concept from Hall, G. E., Wallace, R. C, Jr., & Dossett, v^. A. 
A developmental conceptualization of the adoption process within educational in-- 
stittitions^ Austin: Research and Development Center for Teacher Education, The 
University of Texas, 1973. 
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context. Personalized interventions can facilitate change, but, in the end, each 
individual determines for herself or himself whether or not change will occur. 
Attending to concerns is in no way intended to be a manipulation of the person. 
Rather, adoption agentry is demonstrating the recognition of the inevitaO^le pres- 
ence of concerns within individuals and the extension of a helping hand to assist 
dn coping with cmd resolving those concerns. 



SECTION II. 



THE STAGES OF CONCERN 



ABOUT THE INNOVATION QUESTIONNAIRE 



The SoC Questionnaire was developed to provide a quick-scoring measure of 
Stages of Concern. It Was validated over a three year period, preceded hy ten 
years of measurenent development and reseaurch by Prances Fuller and others as 
they studied the concerns of teachers about teaching. When development of an 
SoC measure was staLrted, several different formats and methodologies were ex-' 
plored. The resulting SoC Questionnaire was tested lor estimates of reliability, 
internal consistency, and validity with several" different sasples and eleven dif- 
ferent innovations. The next subsuction describes briefly the history of devel- 
opment of the SoC Questionnaire r this is followed by reports on the various re- 
liability and validity studies that have been conducte^l. 



In the fall of 1973, the first e^loratory atten5>t8 were made to assess the 
concerns of ^dividiials aax>ut a specified innovation.- The first pilot instru- 
ment consisted of an open-ended concerns statuioent and a forced ranking. Vari- 
ations in opeij-ended formats, the use of Likert scales, adjective checklists, 
and interviewing procedures all were explored initially. 



By the early spring of 1974, two strategies for measuring Stages of Concern 
had been identified. The primary strategy was the development of an instrument 
in the form of a quick- scoring pencil-and-paper questionnaire . The second strat- 
egy entailed the development of a clinical instrument using open-ended questions 
and an objective scoring procedure for classifying individual responses. The 
SoC Questionnaira (SoCQ) was the product of the first strategy; the Open-Ended 



Concerns Statement (Newlove & Hall, 1976) was the result of the second strategy. 



\ L-ae first major step in develo|>ing the SoCQ was to identify potential items, 

project staff members were asked to write items that could ihdicate a concern of 
aA individual at a particular stage. Definitions and scale points from the orig- 
inal CBAM paper (Ball, Wallace, & Dossett, 1973) were used as guidelines. Itans 
also vere seli^cted from the ppen-Ended Concerns Statesaent data that had been col- 
lected during the pilot studies. 

Five hundred forty-four items were generated by the staff. Using the defi- , 
^tions from th^- original CBAM paper, item-cards were sorted into eight groups ' 
by ten people. The groins corresponded to the seven Stages of Concern and an 
••unacceptable" category. The results of the Q-sort indicated that at least 400 
items were related to a given Stage of Concern, as agreed upon by si^ or more 
of the judges. 



Develojanent of the SoC Questionnaire 
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Those ic vns agreed to were edited for redundancy and reworded into complete 
statements. One hundred ninety-five items were selected through this process 
and included on the pilot instrument. 

In May of 1974, the pilot instrument of 195 items was sent to a sample of 
teachers and college faculty stratified according to years of experience with cin 
innovation. Two innovations were identified — teaming in elementary schools and 
the use of instructional modules in colleges « Both users cind nonusers of the in- 
novations were involved in the study. Three hun<?red fifty-nine questionnaires 
were returned and construction of subscales was initiated. Item correla^tion and 
factor analyses indicated that seven factors Explain over 60% of the comnib^ var- 
istnce among the 195 items and that the hypothesized scales cojrrespond to thCs^ 
factor scales. ^ 

Selected persons who had completed the 195-item SoC measure were Interviewed 
to assess their concerns about the innovation. Judges reached agreement on how 
each person should be classified and these data were subjectively correlated with 
a person's classification on the 195-item measure. 

A 35*item questionnaire was ^/.epared by selecting items from each of the 
factors of the 195-item questionncd.re. In Septembar 1974, this questionnaire was 
administered to 171 higner education and elementary school faculty members. One 
week later, the same form vr-as readministered t^ establish tcst-retest reliability. 

Durihg the subsequent two years ^ the j5-item SoC Questionnaire was used in 
cross-sectional and longitudjjial studies of 11 different educational innovations. 
Several different validity studies have been explored. The SoCQ data has been 
con^red with expert judge latii^gs of Qpen-Ended Concerns Statements. Respond- 
ents have been interviewed about their concerns and the interview tapes rated 
for concerns. These ratings then have been contrasted with tha PoC Questionnaire 
data. Individuals have been asi^d to respond to SoC stage definitions and to in- 
dicate their relative intensity of concern^ and Level of Use interview tapes have 
been analyzed to determine concerns. The 3oC Questionnaire data have been inter- 
preted and predictions made about what the respondents would reflect in an inter- 
view; these predictions were compared to actual interview data. And extensive 
dialog and interaction have occiirred dujting the two years subsequent to the SoCQ 
developnent as the project sta.^f developed cuid refined procedures for interpret- 
ing the data. 

The general conclusion id that the SoC Questionnaire accurately meas^'ores 
Stages- of Concern About the Innovation. In fact, the SoC Questionnaire appears 
to do an even better job than other measures cind clinical judgments. 

The next subsection presents more detailed psychometric information about 
the SoC Questionnaire; Section IV provides an extensive discussion about inter- 
pretation. 

Reliability of the SoC Questionnaire 

The items representing each stage on the questionnaire were selected in such 
a manner that high internal reliability was very likely. One of the necessary 
conditions for am item to be included was that responses to it correlate more 
highly with responses to other items measuring the same stage than with responses 
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to items on other scales. As a result, high internal reliability was assured. 
Figure li.l shows the alpha coefficients of internal consistency for each of the 
seven Stages of Concern scales. These coefficients reflect the degree of relia- 
bility among items on a scale in terms of overlapping variance. The formula is 
a generalization of the Kuder-Richardson Fonmila 20 for dichotcnnouS items 
(Cro.ibach, 1951). Program TES^at on the VSTAT library (Veldman, 1967) was xised 
to compute these coefficients using data from a stratified sample of 830 teachers 
and professors. Many of these persons provided data for the two-year longitudi- 
nal studies of concerns. The coefficients in Figure II. 1 were co^uted on the 
basis of their responses in the fall of 1974, their first exposure to the ques- 
tionnaire . 



Figure II. 1. Coefficients of Internal Reliability 

for the Stages of Concern Questionnaire, N = 830 

Stage 0 1 2 3 4 5 6 

Alphas .64 .78 .83 .75 .76 .82 *71 



A sample of 171 individuals were asked to con^lete thfe SoC Questionnaire a 
second time, two weeks after their initial completion of the instrument. One 
hundred thirty-two cOT«>leted and mailed in this "retest" data. Test-retest- cor- 
relations were computed and are shown in Figure 11.2. 



Figure II. 2. Test-Retest Correlations 

on the Stages of Concern Questionnaire, N = 132 



Stage 



Pearson-r .65 .86 .82 .81 .76 .84 .71 
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Validity of the SoC Questionnaire 

The validity of the scores on the SoCQ as measures of the defined Stages of 
Concern could not be demonstrated as easily as could their reliability. There 
does not exist another measure of concerns with which the SoC Questionnaire could 
be conqpared easily. Following the strategy outlined by Cronbach and Meehl (1955) , 
an atten^t wais made to demonstrate that scores on the questionnaire relate to 
each other and to other vulables as concerns theory would suggest. Thus, inter- 
correlation matrices, judgments of concerns based on interview data, and confir- 
mation of expected group differences and changes over time have been used to in- 
vestigate the validity of the SoCQ scores. 

Correlation Matrices and Factor Analysis 

The first indications that the questionnaire might measure concerns as con- 
ceptualized came with the analysis of the 195-item pilot checklist (May 1974) . 
This prototype instruipent contained six subscales (Stage 1 through Stage 6) . Each 
stage consisted of between 14 and 68 itsms (which had been Q-sorted by the staff 
into those stages) . Evidence for the validity of these st^ages as separata con- 
structs which were related in a developmentcU. way comes from two analyses. An 
analysis of the data from 359 persons who had con^^leted the 195-item questioifiiaire 
indicated that 83% of the items correlated more highly with the stage to which 
they had been assigned than with the total score on the instrument. Ind^d, 72% 
correlated more highly with the stage to \rtiich they had been assigned than with 
any other stage. 

Each item, it should be noted, was responded to on a zero through seVen 
scale, a high response indicating that the person considered that item to be "very 
true of ma now." j^cores were computed by adding the responses for the items in 
each scale; the susn of the scale scores constituted the total score. Thip cor- 
relational evidence indicated that the items on a paurticular scale tended to be 
responded to similarly, the inference being that the items in each scale measured 
a notion distinct from notions measured by other scales. 

Later, a correlation matrix was computed b2ised on these same data. Figure 
II. 3 is a summaury of how the scales (each measuring one stage) inter cor re late. 

The correlations near the diagonal are higher than those more removed from 
it. Guttman (1954, 1957) hac applied the term simplex to this type of pattern. 
The simplex pattern in a matrix corresponds to a set of objects having degrees of 
similarity and dissimilarity with one another in such a way that they can be ar- 
ranged on a line. Each object will be more like an object immediately beside it 
than like any object farther away on the line. Thus, the scales on the pilot 
questionnaire Indicated an order consistent with the hypothesized order of the 
^Stages of Concern. 

Because of programming limitations, it was necessary to select 150 items 
from^e 195 before subjecting the data to a factor analysis. Content of items 
and it^&^scale correlations were examined; 45 items were deleted for this analy- 
sis. An image covariance matrix based on the 150 variables and 363 respondents 
was subjected to principal conqponents factor analysis with varimax rotation. 
Seven factors ^ere extracted even though only six were hypothesized in order to 
allow for wore^ coit^lete examination of the stmicttire of the matrix. As it tiirned 
out, the seventh factpr proved to be very relevant to the Stage of Concern theory 
in that it was immediately identified as representative of Stage 0 concerns. 
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Figure II. 3. Intercorrelation of 195-Item 

Stages of Concern Questionnaire Scales 
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Staff members were asked to peruse the 195 items in the pilot questionnaire 
and identify those items which reflected Stage 0 concerns. (No items had been 
specifically designed to reflect these concerns on the basis of input from ex- 
ternal consul temts who did not believe Stage 0 was relevant to the theory.) 
Each item selected by at least six of ten staff members as representative of 
Stage 0 was reclassified. Most of these items had been Stage 1. Thus, it was 
possible to identify each of the 150 items in the factor analysis pool with one 
of the seven (0 through 6) Stages of Concern. It was observed that the items in 
each stage had primary loadings predominantly on onp of the variraax factors. 

A comparison of the hypothesized scales with the obtained factor structure 
revealed surprisingly high congruence. Stages of Concern scores calculated by 
summing each person's responses on the intern oz each scale can be correlated 
with factor scores computed on the basis of ^ne vaurimax rotated factor structure. 
A program developed these correlations, which are summarized in Figure II. 4. 
This matrix shorn that varimas factor 7 corresponds to the SoC scale for Stage 0, 
factor 1 corresponds to Stage 1, etc. This analysis led project members to infer 
that the seven scales tapped seven ir 'ependent constructs %Aich could be identi- 
fied readily with the seven Stages of Concern proposed in the Concerns-Based 
Adoption Model. 

Correspondence Between SoC Questionnaire Scores and Other Measures of Concern 

In September 1974 , 27 professors coii??leted the 35-item questionnaire and 
also filled out an open-ended response questionnaire which asked them to say what 
they were concerned aODout "when you think about your use of modules." Each of 
these 27 professors was yiven a Stages of Concern rating by four CBAM staff 
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Figure II. 4. Correlations Between V£u:im2uc Factor Scores cmd Scale Scores 
on the Pilot Stages of Concern Questionnaire — 
Analysis of 150 Iteias, 363 Respondents 
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members. These our judges met and developed a consensus on each of the 27 SoC 
ratings « Independent ratings pn the 27 open-ended statements had an estimated 
.59 reliability. Group consensus reliability was estimated at .84. These esti- 
mates of judgmental consistency were computed' using a technique described by R, 
L. Ebel (1951) and programmed by Veldman (1967) . 

' Multiple regression was used to determine the relati6nships between rated 
SoC and scores on the questionnaire. Using raw scores on the seven (0 through 6) 
scales as predictors , a multiple R of .58 was obt2d.ned. This was not significant 
at the .05 level for these few subjects and this many predictors. When raw scores 
on Stages 0 and 6 only were used^ the multiple R dropped only slightly to .52, 
which is significant at the .02 level for two predictors and 27 subjects. Thus, 
there is certainly seme relationship between SoC scores and ratings of concerns 
expressed on open-ended statements. Considering the difficulty of the rating 
task^ the recognition of this relationship was encouraging. 

In the spring of 1975, smother check on the validity of the SoC was made. 
As part of a cooperative evaluation study with Austin Independent School District, 
161 teachers involved in individualizing math and reading were assessed as to 
Levels of Use and Stages of Concern of these innovations. Forty teachers who had 
extremely high or low factor scores on SoC Stages 2 or 5 for reading (ten teach- 
ers high on 2, ten low on 2, ten high on 5, ten low on 5) were interviewed for 
concerns eUx>ut individualized reading. These interviews were caurefully planned. 
Cue questions were asked which elicited information concerning each of the sieven 
(0 through 6) concerns categories. Probes were used in the event that not ^enough 
specific information was provided initially. Following the formal interview, the 
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teachers were given a short, written description of the Stages of Concern. Each 
teacher reviewed each of the descriptions and indicated on a one-to-eight scale 
how true that was of her/him at that time. She/he was then asked to indicate, 
on a separate sheet, the two descriptions about vAiich she/he was most concerned 
and the two she/he was least concerned about. (It was noted that, in many cases, 
the teachers' responses on paper seemingly were incongruent with what they had 
just said in the interview, and even inconsistent in themselves.) 

When raw scores were used to predict interviewers' ratings of concern at 
each stage, results were produced similar to those obtained in the study de- 
scribed above. In this case, ratings of concern on each stage were being pre- 
dicted instead of overall SoC. Stages 1, 3, 4, and 6 each had multiple R's over 
.56, signifies jit beyond the .05 level. Stages 0, 2, and 5 were predicted with 
R's of .52, .50, and .45, which were not significant at the .05 level but were 
consistently high. Again, it was clear that these ratings of concern on each 
stage were related to the concerns expressed on the SoC Questionnaire. 

An important consideration is that there are indications that the teachers 
in this study were not a satisfactory sample on which to examine validity of the 
SoC Questionnaire. Some were very much overburdened with innovations and others 
were anxious about upcoming school district decisions concerning the individual- 
ized concept in general. It is likely that individualized reading was not a 
priority for many of these teachers. Indeed, fully 33% of the teachers who were 
said to be using the program were rated as nonusers in an evaluation study. In 
addition, the reliability estimates (alphas) on the SoC Questionnaire scales 
were amazingly low as compared to other samples of teachers. Figure II. 5 shows 
the means, sigmas, and alphas for the 40 teachers con?>ared with tlie same statis- 
tics previously obtained on 380 teachers and professors in other studies. 

Not only are the alpha coefficients strikingly lower, but \±e scores on the 
stages indicate a lack of concern for this innovation. The 40 teachers have ex- 
tremely high Stage 0 concerns (\inconcemed about the innovation) and are much 
lower elsewhere. Considering the low reliability of the SoC scores within this 
group, it is somewhat surprising that a significant degree of correspondence 
between them and the other measures was obtained. 

A more rigorous vad-idity study was conducted in August and September 1976. 
The research focus in this effort was expressed as follows: How accurate are 
inferences about a person's concerns about an innovation likely to be when these 
inferences are based on the SoC Questionnaire data? In order to answer this 
question, staff members first assessed a person's concerns by listening to taped 
interviews. That person's concerns were estimated, then the actual SpCQ scores 
were examined. This procedtire enad^led the investigators to provide quMtitative 
ratings on the person's conceqrns prior to exposure to SoCQ scores, so that com- 
parisons couid be made. Pilot studies had shown that when the investigator is 
exposed to SoCQ scores prior to assessing concerns in some other manner, a typi- 
cal reaction had been that the scores did reflect the person's concerns, but 
these judgments may have reflected a py^malion prophesy. It was then impossible 
to assign quantitative concerns scores on the basis of the alternate measure 
without bias due to exposure to the SoCQ scores. 

D<tta analysis were based on: 

1. The investigators' ratings of SoC based on a taped interview. The 
highest perceived concern was indicated along with one or two "also 



24 



16 



Figure U.S. SoC Questionnaire Statistics on 40 Eleioentary Teachers 
Involved In AISD Validity Study, Compared with 
SoC Standardization Data, N » 830 

Stages of Concern 
0 12 3 4 5 6 Total 

40 Validity Study Teachers 

mieans 20.0 12.0 17.0 

sigmas 7.7 6.6 6.3 

alphas .69 .56 .52 

646 St£uidardization Sample Teachers 

means 5.8 12.9 13.5 

* sigmas 5.4 9.2 9.8 

alphas .62 .81 .85 



high" concerns. The remaining four or five stages were, by in^ll- 
cation, of lower concern. 

2. SoC raw stage scores (seven plus total) . 

3. SoC percentile scage scores (seven plus total). 

It should be pointed out that the interviews used were Level of Use interviews 
that were purposely designed to minimize rather than elicit concerns input from 
the interviewee. Thus, the staff had to infer concerns from interviews that had 
not been spcjificeilly designed to measure concerns. Three staff members were 
involved in this vcLLidlty study of 28 persons selected at random from the spring 
1976 sainple in the two-yeeu: study. 

The first analysis investigated the reliability of the investigator's ratings 
of concerns. In general, reliabilities were moderate to high, as presented in 
figure II. 6. Ratings of the "highest" and "also high" concerns showed group re- 
liabilities between .42 and .85. Six of the seven were above .58 (p <.01). Only 
Stage 3 showed a non-significant reliability (.42, p " .06) . These were very en- 
couraging findings because pilot attempts at assessing concerns from interviews 
had provided less relied^le data. 

Figure II. 7 shows the correlations between the investigator's ratings and 
the rank ordering of the SoCQ percentile scores. Ideally, high diagonal correla- 
tions would be obtained. Indications are that Stage 5 is the "cleanest" (r « .54). 



18.3 1 ,3 16.9 15.5 116.0 
7.9 7.6 6.3 6.6 41.0 

.62 .54 .41 .41, .91 



14.0 23.4 20.0 
8.1 8.0 8.5 

.77 .79 .83 



16.6 106.2 
8.0 36.6 
.75 .90 
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Figure II. 6. Reliability of Ratings of Stages of Concern 
in VeuLidity >tudy Analysis 
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stages 1 and 2 show high diagonal correlations, but also correlate with each 
ocher off the diagonal. Stages 0, l^.and 6 are marginally clean, while Stage 4 
failed to correlate on the diagonal at all (r « .13). Six out of seven signifi- 
cant correlations on the diagonal is very good. Twenty-two of the 42 off-diago- 
nal elements were non-significant. Half of the off^iagonal significant correla- 
tions were negative (5/11) . It can be concluded that, except for Stage 4, valid- 
^ . ity o$ the SoC is ^supportea ui this matrix. Some indication of non-independence 
of S,tages 1 and 2 is evident. 

Convincing demonstrations of t;he validity of the Stages of Concern Question- 
naire have come in the course of its use over the two yeaors of longitudinal 
study. One case in which the SoC scores dramatically reflected changes in con- 
cerns vAiich had been predicted by concerns theory involved the faculties of two 
elementary schools in an urban school district who' were invited to participate 
in a summer workshop where they would help develop and learn *how to use a new ap- 
proach to reading instruction. The new approach, which was to replace a tradi- 
tional basal reader program^ might best be described as a diagnostic-prescriptive 
program. It calls for teachers to begin by assessing student needs, followed by 
the establishment of specific instructional objectives, appropriate instruction, 
and finally careful evaluation of pupil mastery of the stated objective. Al- 
though thi^ new approach continues to utilize basal readers, they are used, or 
supposedly used, in very different ways. In fact, the new program requires a 
very different way of teaching reading. 

< 

As i: turned out, approximately half (N » 2^) of the faculty members were 
able (and willing) ,to attend tlic five-week summer workshop. To accocranodate thode ' 
who were not in the workshcy (N « 25) , a one-day workshop was set up just prior 
to the opening of school in the fall to explain the new program and its implications 
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Figure II. 7. Correlation of Peak Stage Estimates 

and Rank Order o£ SoC Percentile Scores 
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for them. On that same day in a separate location, the workshop participants were 
meeting for a different purpose. 

Before aaiy formal training began with either group, both groups were asked to 
con^lete the Ctages of concern Questionnaire which measured their concerns abov.c 
the new reading program* 

I 

Persons who had been dj^posed to the workshop had higher scores on Stages 3, 
5, and 6, while those not iri the workshop had higher scores on Stages 0, 1, and 2. 
(All differenv'^ea were significant beyond p < .05.) There were no significant 
differences . i Stage 4 concerns between the two groups. 

Another case demoustrating the validity of the SoC Questionnaire involved 
the facPTlty of a single school v^ich was part of a longitudinal study of team 
teaching. The teachers in ttiis particular school moved from not teaming through 
establishing teaming as a roitine ove: a two-year period. As hypothesized by SoC 
theory, their concerns shiftjsd from being high on the Icwer (0, 1, 2) v-'tages 
through a high c*" management concerns (3), and finally to fairly low intensity on 
all concerns stages (Figure il.S). As discussed in detail later in the Interpre- 
tation section, coiicems profiles such as this one add support to the validity of 
thfi concerns theory as well ^s to the SoC Questionnaire.^ 



27 



/ 



19 



Figiire II. 8. Two-Year Movement of Teachers' Concerns 
About Teaming In One Small School 
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Summary 

During the two and one--half years of research related to measxiring Stages 
Concern About the Iimovation, the 35-item Stages of Concern Questionnaire was 
developed. In a one-week test-retest study ^ stage, score correlations ranged frou 
.65 to .86 with four of the seven correlations being eQx>ve .80. Estimates of 
internal consistency (alpha coefficients) range from .64 to .83 vdth six of the 
seven coefficients being above .70. n series of validity studies was conducted^ 
all of vdiioh provided increased confidence that the SoC Questionnaire measures 
the hypothesized Stages of Concern. 
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SECTION III. 

USING AND SCORING THE SoC QUESTIONNAIRE 



The SoC Questionnaire consists of three paxtsi the introductory pa^^e, tvo 
pages of items, and a danographic page. The 35 items remain the same for dif- 
ferent administrations with only the name of the innovation changed on the cover 
page. The SoCQ can be administered by mail or in pterson, A cover letter can be 
used to introduce the SoC Questionnaire ^d to further define the innovation. 
Scoring is based on converting the item raw score totals for ea^'-^ scale into per- 
centile scores, which then become the basis for interpretation. 



Coo^nents of the SoC Questionnaire 

Exan5>les of the three parts of the SoCQ — the introductory page, the 35 
items f and the demographic page ^— are included in Appendix A. The Introductory 
page presents the purpose of the questionnaire ^ explains and shows through exam- 
plea how to complete the instrument, and indicates which "innovation" the indi- 
vidual is to consider ^en respondiJig. Space is provided for identification of 
the respondent r either by name or some type of identification number. Finally, 
in the upper right hand comer of the page, a code is- normally written to iden- 
tify the specific institution receiving the questionnaire and the name of the 
innovation being addressed. This latter information expediteai data management 
when d£ta are being collected from more than one institution or about more than 
one ixmovation. 

Figure III..1 is a copy of the introductory page with those elements indicated 
that need to be changed to fit the particular use that is made of the SoCQ. By 
simply changing the name of the innovation in the marked places and identifying 
the institutional setting, the SoCQ is ready for use. No changes are necessary 
in the iteus or other wording on the introductory page. 

The introductory page was revised based on continuing feedback from respond- 
ents during the instrument development process until it clearly conveyed the in- 
formation emd directions needed to get accurate responses. For exasple, in the 
early stages of development, some respondents express^- ' a degree of frustration 
over the items that seemed irrelevant to them at that moment. Thus, the state- 
ment about the applicability of the instrument to a wide range of persons and 
the underlined statement about relevance of items were entered. These steps 
seemed to alleviate much of the fnistration over this point. 

Initially, some teachers tended to respond according to their generalized 
concerns about teaching rather than to concerns about a specific innovation or 
program. Also, there was some tendency to respond on the basis of past concerns 
rather than present concerns. The final paragraph was designed to focus the re- 
sponses on concerns at the time the SoCQ is ccnnpleted. Because it has been 
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Figure III.l Introductory Page of the SoCQ 
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refined so extensively, it is suggested that any changes in the introductory page 
should be made with great c£u:e, for they could influence responses. 

The second part of the questionnaire (see Appendix A) consists of the 35 
items on two pages to w^rhich the individual responds. The respondent mdrks each 
item on a 0 to 7 Likert scale according to how true it is that the item derscribes 
a concern felt by the individual at the present time. The "0" at the end of the 
scale is recomniended for marking items that are completely irrelevant. 

Typically, ten ro 15 minutes are required -to complete the questionnaire. 
In all of the uses of the instrument to date, virtually no respondents have com- 
plained about the reqi-JLrements for conpleting it. Instead, a number of persbns 
have indicated that the items caused them to think about what they were doing in 
ways they had previously not considered. 

Although the questionnaire is in no way a test, it is iiTi)ortant that respond- 
ents complete it without consultation with cuiyone. The purpose is to identify 
the concerns of individuals, not consensus concerns of several persons. 

Tha third, and optional, part of the SoC Questionnaire is the demographic 
page. This page has been found extremely useful in gathering other information 
about the respondents for both sample description and correlation -ptirposes. 
Questions on this paxt of the questioiinedtre vaury according to the information 
Tiecrts of the person or group issiiing the instrument. This part of the question- 
naire could bfe emitted if there was no need for demographic infoncation, or 
changed in whatever ways are needed to fit a particular situation. A sample 
demographic peige is found in Appendix A. 



Administering the SoCQ 

There is no prescribed setting or process for administration of the question- 
naire, '^o date, it has been adm.inistered in the following ways: 

1. Mailed out with a deadline for completion and picked up personally 
by the issuing person or group. 

2. Handed out personally and returned by mail. 

3. Issued and returned via mail. 

4. Personally issued and collected on an individual basis. 

5. Administered to gro\:5)s by a project representative. 

The seriousness with which individuals respond to the questionnaire does 
not seeiL to vary noticeably in rel'Ation to the* method of administration. UnHcjr ^ 
all of these conditions, a high percentage of subjects have responded to every 
item with a minimvun of confusion and with a response pattern indicating careful 
and independent consideration of all items. 

Several cautions that should be considered when administering the question- 
naire are: 

1. If the return of the questionnaire is by mail, the percentage of 
returns is likily to be reduced, especially if it was issued by 
mail. 
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2. Respondents should not be eisked to return tl'ieir questionnaire to an 
inmediate superior, e.g., teacher to principal; such a process can 
be threatening to respondents and create at atmosphere of suspicion 
within an institution. It is acceptable, however, for a superior 
tc^i distribute the forms if they can be retujmed somewhere else. A 
stan^d, addressed envelope attached to the questionnaire has proved 
useful in the past. 

3. When administering to a group, it is best to discourage questions 
of clarification. The questions may "snowball" to the point that 
responses of individuals are influenced. 

When the SoC Questionnaire is to be administered in other than face-to-face 
ways, a cover letter should be attached. The cover letter can introduce the ques-* 
tionnaire, define the innovation, and explain the importance of completing the 
questionnaire. Instructions about handing in the completed questionnaire can also 
be included in the edver letter. In r jb cases, the cover letter may also be used 
to introduce the respondents to the person (s) conducting the data collection ef- 
fort. One overriding rule to follow ii^ developing a cover letter is to be cleair 
and to cover the necessary points in a very brief amount of space. 

A san^le cover letter and copy of the SoC Questionnaire are included in Ap- 
pendices B and A, respectively. As noted before, changing the introductory page 
may lead to confusion for the respondents. The items should definitely be left 
unchanged (see Section V, Limitations and Restrictions). 



Scoring the SoCQ 

Scoring of the questi<»maire is a relatively simple process. Computer pro- 
grams, which are described and included in Appendix C, have been written to score 
the SoCQ and to display the data in a useful format. However, the measure can 
also be hand-scored, especially convenient when only a small number of question- 
na^iires need to be processed. In addition, anytime a computer program is used, a 
few cniestionnadres should be hauid-scored to verify the computer output. 

The questionnaire consists of 35 statements, each expressing a certain con- 
cern about the innovation. Respondents indicate the degree to %Aich each concern 
is true of them by marking a number next to each statement^ on a 0 to 7 sc^le. 
High numbers indicate high concern, low numbers low concern, and 0 is indicative 
of very low concern or coo^letely irrelevant items. 

The 35 statements in the questionnaire were caurefully selected to represent 
seven fundamental areas of concern. Each scale consists of items that are repre- 
sentative of concerns which are prominent at a specific Stage of Concern, accord- 
ing to the concerns theory. Each of the seven Stages of Concern is represented 
by five statements. The ''raw score" for each scale is simply the sxim of the re- 
sponses to the five statements on that scale. Figture III. 2 shows the item numbers 
and statements, arranged according to Stages of Concaim. Figure III. 3 dhowa the 
item numbers and Stage of Concern with which that item is associated. < 

Once the seven raw scale scores have been obtained, it Is usually necessary 
to convert these to percentile scores to interpret them. Figure III. 4 shows the 
sca).e score ar.J the percentile of that score for each of the seven Stages of 
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Figure III. 2* Statements on the Stages of Concern Questionnaire 
Arranged According to Stage 
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Figure 111.3. Item Numbers and Associated Stage of Concern 
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Concern. The total score, which is sinply the sum of the seven raw scale scores, 
may also be converted to a percentilta sc2J.e. Figure III. 4 also contains the 
total scores and corresponding percentile scores. 

These percentiles are bas(3d on the responses of 646 individuals who coinpleted 
the questionnaire in the spring of 1975. The individuals were a carefully select- 
ed stratifiad sample from elementary schoolr and higher education institutions 
with a range of e^qperience with the innovation of teaming oir modules. Experience 
has shown that xi^e percentiles in this table are representative of other innova- 
tions. The validity ctudies reported in Section II were conducted using these 
percentiles to interpret concerns about several innovations. 



Displaying SoCQ Data 

SoCQ data cm be displayed in different kinds of tables or graphically. The 
coot -^^ program listed in Appendix C provides for two basic displays. Either 
the stage and total percentile scores c^ be displayed for a set of individuals 
(e.g.. Figure IV. 1), or the item responses amd total stage raw scores and percen- 
tile scores can be displayed as in Figure IV. 16. 

The SoCQ data can dUso be suanarized for groups of individuals. This can be 
done by reporting means for each stage, or the frequency of highest individual 
score on each stage Ce.g., Figure IV. 2). These two susnary displays are described 
in Section IV. Interpretation of SoC Questicnnaira Data. 
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Figure III. 4. stages of Concern i5core-Percenti3.e Conversion Chart 
for Stages of Concern Questionnaire 
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Graphic representation of the percentile scores often greatly assists inter- 
pretation of SoCQ data. Figure II. 8 on page 19 is an example of such graphing. 
A t)lank graph which has been specifically designed for SoCQ profile presentations 
is included in Appendix D. To plot an individueil or group profile, simply mark 
each vertical line at the point representing the percentile score for the ap- 
propriate Stage of Concern. Then connect the marks using a ruler or strail^ht- 
edge and pencil. It is recommended that the blank included here be copied so 
that all the graphs will have the same framework and sqale. 

Interpretation of the percentile scores is explicated in this manual in the 
next section. When scores are used in statistical analyses, we strongly^ encour- 
age the use of the raw scores. Conversion to percentiles greatly affects the 
distribution of the scores (tending to make the distribution rectamguleu:) , making 
„ statistical assumptions more tenuous than would otherwise be the case. 



SECTION IV. 

INTERPRETATION OF SoC QUESTIONNAIRE DAIA 



Once collected and processed. Stages of Concern Questionnaire data can be 
interpreted at several different levels of detail and abstraction. The sinplest 
fora of interpretation is to identify the highest stage score (Peak Stage Score 
Interpretation) .* A more detailed interpretation can be developed by examining 
both the high stage score and the second highest stage score {Firat and Second 
High Stage Score Interpretation) . The most sensitive interpretation can be de- 
velc^d by analyzing the cpaaplete profile (Profile Interpretation) . By exam- 
ining the percentile scores for all seven stages emd interpreting the meaning of 
the different highs and lows and t^eir interrelationships, a very rich, clinical 
picture can be developed. 

Interpretation* of profiles will reqxiire some study and practice; however, 
the process in general is fairly easy to understand for those who have a clini- 
cal bent. For those who want a fpxLck and relatively simple method, the strc^ight 
forward quantitative interpretation of hi^ and second hig^i scores will ptobably 
be most useful. 

ii 

Regardless of the interpretation procedure, caution must be taken in ac- 
cepting an inteirpretation as the tixml truth. The interpretations that are made 
2ure only as good as the measure, the genuineness of the responses made by the 
respondent, and the skill of the interpreter. Therefore, all -interpretations 
must be treated as hypotheses to be confirmed by the respondents, with their 
confirmation or rejection used to adjust and adapt the hypotheses. 

Interpretation of the peak scores, the second highest scores, and profiles 
all can be done with individual or group data. Obviously, the larger the group 
the less sensitive to individual differences the interpretation will be. With 
any of these methods » the resultant interpretation also can be con^ared with the 
demographic data items. In some instances, the demographic data will help ex- 
plain vdiy certain concerns stages are more. or less intense. 

This section of the manual is divided into Subsections that deal in depth 
with each of these interpretation procedures. Sample data and analyses are 
presented. The discussion imfolds from the simplest anc. lysis to the most com- 
ply. By beginning with the straightforward procedures outlined, a full descrip* 
tion of the concents of the resp<mdeAt(s) can be developed. The more intricate 
assessments that are described can be mastered with experience and by checking 
out hypothesized interpretations urith respondents. Of cov^rse, previous psychol- 
ogical knowledge and training could be very useful tools for interpreting more 
con^lex oases. 
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Peak Stage Score Interpretation 

The procedure for analyzing SoCQ data based upon peak scores is nearly the 
sane for individual and group data. Each stage percentile score can be listed 
as illustrated in Figure iv.l. Prom this listing, ^the highest stage scores for 
each indiv3.dual and the group can be identified. In dealing with a listing of 
percentile scores, sometimes it is useful to go down through the individual 
listings and circle the highest stage score for each individual, as has been 
done in the figure. Occasionally, another stage score will be within one or two 
percentile points, in which case both can be circled. Note that the Total Score 
is not used in this interpretation procedure. For more information about Total 
Score, see page 49. 



Figure IV. 1. Listing of Individual Stage of Concern Percentile Scores 
for a Science Curriculvmi Innovation 
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Interpretation of the high score is based directly on the Stages of Concern 
About the Innovation definitions that were presented as Figure 1.2 on page 7. 
The stage scores are directly related to the stage definitions with the relative 
intensity of concern being indicated by the percentile score. The higher the 
score; the mora Intense the concerns at that gtage. The lower the score, the 
less intense the concerns at that stage. Higher and lower are not absolute, 
however, but relative to the other stage scores for that individual. Thus, a 
51st percentile for one person may represent her/his highest score and, there- 
fore, her/his most intense Stage of Concern, while a 51st percentile stage score 
for another person may represent her/his lowest stage s^coi;e ~ a stage where 
there is not a great deal of concern. 

Individuals in Figure rv.l can be used to illustrate this interpretation 
procedure. For example, the highest Stage of Concern for the first individual 
listed is Stage 4. An 86th percentile score suggests that the individual is con- 
cerned about the "Consequences" of the innovation for students. Thi^ respondent 
is roost concerned about her/his students and the effects of the innovation on 
them. . 4 

Other pectk stage scores can be interpreted directly from the SoC defini- 
tions as in the pi^evious example, with the exception of Stage 0. As described 
in more detail later in this section. Stage 0 has two very different meanings 
depending upon whether the respondent is a nonuser or* a user of the innovation . 
For nonusers of the innovation, a high peak score on Stage 0 reflects awareness 
of and concern about the innovation, while for users of the iimovation, a high 
Stage 0 score* indicates lack of concern about the innovation. A high Stage 0 
score is the only case when the peak score alone would •"ot be sufficient for 
interpretation. Other information is required. Often stud^ of other stage 
scores is helpful. Usually nonusers who are high on Stage 0 will also be high 
on Stages 1 and 2, vrtiile users who eure high on Stage 0 will be low on Stages 1 
and 2. Other sources of additional information include demographic data and 
outside judgment of whether or not the individual , is using the i nnovati;^n . 

A high Stage 1 score is indicative of- intense concerns about what the inno* 
vation is and what use of the innovation entails. Persons who have intense 
Stage 1 concerns are interested in having more descriptive information about the 
inn«>v:ation . They are not concerned aJaout "nitty gtitty" details, but, rather, 
want general information about what the innovation is, what it will do, and what 
use would involve. Stage 1 concerns do not have a strong "self" component. 
They are quite ^substantive in nature, focusing on the structure and fianction of 
the innoT^tion. 

Stage 2 Personal concerns deal with what Fuller referred' to as "self" con- 
cerns. A high Stage 2 score is indicative of ego-oriented questions and uncer- 
tainties about the innovation. Concern about status, reward, and potential or 
real effects of the innovation on the respondent are of high concern. A respond- 
ent with relatively intense personal ^concerns may, in effect, operationally 
block- out more siibstantive concerns about the innovation. ' 

A high Stage 3 score is irdicative of intense concern about management, 
time, and logistical aspects of the innovation. Similcu: descriptions and inter- 
pretations can be made of peak scores on Stages 4, 5, and 6, interpreting the 
high score directly from the Stages of Concern About the Innovation definitions. 
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There are tyao recouunendad ways of treating gro^n^data. One way, illustrat- 
ed in Figure iv.2r is to tally the number of individuals that are high on each 
stage. This gives a clear picture of! the range of peak stage scores within a 
group. 



Figure IV. 2. Frequency of Highest Concerns Stage 

for the Individuals Displayed in Figure IV. 1^ 

^ ^ Highest Stage of Concern 

* 0 1 • -2 ' '3 4 5 



Nqmber of 

, ^ * Individuals 



Another way to treat grot^ ^data is to aggregate individual data by develop- 
ing a profile tljat presents the mean scores for each stage of the individuals lii 
a group such aa ^ school faculty or the vzgriov departments of a college. This 
i^ illustrated in Figure IV. 1. It shoul^ be nuted that the more individuals 
' ^ that a*-e aggregated, the less lively the mean is to be representative of the in- 
diviatal scores. 

Normally, the group averages wilx reflect the dominant high and low Stages 
of (Concern of the composite group; however, the individual highs should also be 
checked in case there distinct^ subgroups. This' is vrhere the first treatment 
of group data, .-the frequency count of high stage scores, is beneficial. It can 
alsa be the case that Averaging individual data obscures any high peak score 
trends. This is the case lA Figure IV. 1. Keeping in mind these problems with 
a^9re9is<ting data, Interpretation isi again the straightforward trauislation of the 
high ai^Q Ltw stage scores based *on the Stages of Concern definitions. 



Second High Stage Score Interpretation 

To develop additional insight into the dynamics of concerns, the seczond 
high stage score as well as the peak stage score can be sm'^lyzed. Again, this 
analysis can be done with individual or group data. 

Assimlng the seeming development^l nature of concern, the saccnd hi<:jhest 
Stage of Concern will often be adjacent to the highest Stage of Conc6m. That 
is# if an individual is high on Stage 3 she/he will fi .gently be second highest 
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on Stage 2 or stage 4. By looking at the sec^d highest Stage of Concern, the 
presence or absence of this general pattern y^an be assessed. 

/ 

Across a group, however, thera are bbimd to be individuals who do not con- 
form to the general pattern. There could be indi\^duals who are highest on 
Stage 3 and stc^nd highest on Stage 6, /or high on Stage 4 and second highest on 
Stage 1. Although some of the possible coinbinations are not very likely, all 
are conceivable. / 

/' 

Analysis of the second high outage score for an individual is also reaison- 
ably strajqhtfoxiward. For examp;ie, in Figure IV. 1^ the last individual listed 
was highf. ;c on Stage 5 and second highest on Stage 4." This individual is in- 
tensely concerr^d about working with others (her/his colleagues) in relation to 
the innovation. The second high Stag^ 4 concerns Indicate That the respondent 
is also concerned about the ^consequences and effects the innovation has on her/ 
his students. / 

A cooanon high/sec<»:id high combina^. a is a person highest on Staae 3 and 
second highest on St^^ 6. Individuals xth this combination are co: cemed about 
management of t>e imovation (high Stage 3) and have some ideas about how to 
Change their^ae (second high Stage 6) . Individuals who are low on Stage 6 and 
high on^^ige 3 do not have ideas about what to do and are apt to be stuck with 
their, e-'jne and effiriexiCy problems. Li^ewiise, these individuals will often be 
seqOTd high on Stage 2, indicating their uncertainty and doubt about whether 
/they can master the innovation. 

With group data, developing a matrix that cross-tabulates the individual's 
highest stage of Concern with her/his second highest is sometimes useful. One 
exasB^le of this approach is presented in Figure IV. 3, \^ere the highest Stage ot 
Concern for most individuals tends to be either stage 0, 3, or 6. The second 
most frequent highest Stage of Concern can be iwantified by selecting one of 
the highest stages of Concern from the left-hand column and reading across. The 
frequencies listed show how the individuals were distributea on their second 
'lighest Stage of Concern. For example, the individuals who were highest cn 
Stage 4 were second highest on either Stage 2 (35%) or Stage 5 (30%) , accounting 
for 65% of the individuals. 



With these data# individuals wixJi high Stage '4 concerns appear to be of two 
kinds: those ^'.o still have very high personeQ concerns (second high is Stage 2) 
and :Ho^e vrtio are very highly concerned about working with otliers (second high 
is Stage 5) . It is very likely thc*t those who are highest on Stage 4 and second 
highest on Stage 5 may be in some teaming structure or at least have high con- 
cerns to begin more collaborative work with their colleagues in relation to use 
of the innovation. Quite different staff develo.oment activities for these t%« 
kinds of individuals with high Stage 4 concerns '«rould obviously be in order.- 

Such an identification of the highest ^d second highest Stages of Concern 
combinations makes for a straightforward atnalysis and presentation that also 
reflects the complexity of concerns data. Other high/second high combinations 
are disoissed the Guidelines, pages 53 to 55. 

The richest an'i roost profitable ir*:erpretation of concerns data is probably 
entailed in a coiPylete profile emalysis. The next subsection deals in detail . 
"^O** P^°^^^® ip*--rpretations. 
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Figure IV. 3- Percent Distribution of Second Highest Stage of Concern 
in Relation to First Highest stage of Concern 
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Profile Interpretation 

As individuals move from unawareness and nonuse of an innovation into begin* 
ning use and more nighly sophisticated use, it is hypothesized that their con- 
cerns develop froa bein^ most intense at Stages IT, 1, and 2, to most intenser at 
Stage 3, and ultimately to most intense at Stages 4, 5, and 6. Particularly if 
the innovation is a positive one aind there is support for its is^lementation, an 
individual's concern profile plotted over time should have the form of a progres- 
sive wave motion from left to right as illustrated in Figure IV. 4. Where the 
individual is in this "growth" sequence can best be assessed through interpreta- 
tion of the complete concerns profile. 

Analysis of concerns profiles, either through looking at the tabular listing 
of percentile scores or the plots of these percentile scores on a graph, provides 
the most complete clinical interpretation and assessr^nt of both individual and 
group data. By use of clinical interpretation techniques, an interpreter cam 
develop a great deal of insight, not only into the type(s) of concern that is (are) 
most intense and least intense, but also into the affective stance that the re- 
spondent is taking towaxds the innovation. 
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J^iqxxce IV, 4 • Hypothesized Development of Stages of Concern 
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Here again, interpretation of profiles, whether it be for individual or 
group data, is beised upon the stage definitions presented in Figure 1.2. In 
this subsection, typical SoC profiles are first introduced and discussed, and 
then a set of rules for interpretation is presented that can guide the reader in 
interpreting some of the subtleties su)d interactions which can occtir across 
stages. In addition to looking at profiles, responses to individual items will 
often be discussed as a further check. The fullness of the picture that can be 
developed depends to a great extent upon use of the rules and guidelines that 
are sunmarized on pages 53 to 55. 

Typical Nonuser SoCQ Profile 

Probably the most readily identified and commonly found concerns profile is 
that of the nonuser. In all of the research that has beer done to date using 
the Stages of Concern Questionnaire, the nonuser concerns profile stands out most 
cleaurly and consistently. Nonusers' concerns are normally highest on Stages 0, 
1, and 2, and lowest on Stages 4, 5, and 6. There is some veuriation in the 
amount of intensity of these concerns depending on the innovatidh and whether or 
not it is a school or college setting; however, the general shape of , the pattern 
is as plotted in Figure IV. 5. 

Nonusers' Stage 0 scores vary from being the highest to being the second or 
thir^ highest. In general, either Stage 0, 1, or 2 is the highest score. The 
variations in Stage 0 do not seem to be as important as do the variations in 
Stages 1 and 2. It is iit^x^rtant to check closely for the relative position of 
Stages J and 2 and also the relative position of Stage 6 in order to understand 
charactaristic differences in the nonuser profile. 

The profile illustrated in Figure IV. 5 is that of a normal, interested in- 
dividual who is somewhat aware of and concerned about the innovation (Stage 0) 
and is interested in learning more about the innovation from a positive proactive 
perspective (Stage 1 slightly higher than Stage 2) . The individual at this time 
does not have a great deal of management concerns (medium intensity Stage 3) and 
is not intensely concerned about the innovation's consequences for students (low 
Stages 4 and 5). The low tailing-off Stage 6 score suggests that the individual 
does not have other ideas that would be potentially competitive with the innova- 
tion. The overall profile suggests and reflects the interested, not terribly 
over-concerned, positively disposed nonuser. 

In contrast to the positive nonuser concerns profile. Figures IV.6 and IV. 7 
represent profiles depicting various degrees of doubt and potential resistamce 
to the innovation. This can be clearly identified in what is referred to as the 
"one/two split." When the Stage 2 concerns are equal to or more intense than 
the Stage 1 concerns, the innovation is perceived much differently than in the 
previous illustration. In general, when such a "negative one/ two split" occurs, 
personal concerns (Stage 2) override conusms about leeuming more about the in- 
nova on (Stage 1). The individual is much more concerned 2Qx>ut her/his person- 
al p iition and well-being in relation to the change than she/he is interested 
in learning more of a substantive nature about the innovation. Experience has 
shown that, even when general, non- threatening attempts are made to discuss the 
innovation with a person with this profile, the high Stage 2 concerns are inten- 
sified and the Stage 1 concerns are reduced. For this kind of person. Stage 2 
concerns normally have to be reduced before she/he can look at a proposed inno- 
vation objectively. 
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The tailing-up of Stage 6 on the typical nonuser concerns profile provides 
further information about the attitude of the respondent toward the innovation. 
When Stage 6 tails off or down at the en^ of the nonuser curve , as in Figure 
IV. 5, this generally means that the respondent does not have other ideas that 
would potentially compete with the innovation. However, when Stage 6 concerns 
tail up as in Figure IV. 7, then one can infer that the respondent has other 
ideas that she/^e sees as having more merit than th^i proposed innovation. The 
Stage 6 tailing-up needs only to be seven to ten percentile points to be detect- 
able in terms of the overall concerns of the individual. Thus, any tailing-up 
of the Stage 6 concerns on a nonuser profile should be taken as^a potential warn* 
ing that there may be resistance to the innovation on the patrt of the respondent. 
A more severe tailing-up should be heeded as a loud annovmcement . 

Single Peak User Profiles 

The most frequently found user concerns profiles have a single peak at . 
either Stage 3, 4, 5, or 6. In general, profile interpretations can be based 
heavily upon the definition of the stage that has the highest score. In many 
cases, the second highest scores will be quite a bit lower than the highest stage 
score. If tjie sorond highest score is more than 20 percentile points below the 
highest, it noinnally does not account for very many of the intense concemiK<^ 
the respondent. If certetin stage scores are dramatically low, then these are 
areas where individuals are reporting ^^^^ they have minimal or no concerns. 

In Figure IV. 8, for example. Stage 3 Managenent concerns are relatively in- 
tense. The respondent is indicating higli concern about time?, logistics, or other 
managerial problems related to the innovation. The respondent is also somewhat 
concerned about students (Stage 4) , but not concerned aJ^out working with others 
down stage 5). She/he does not have intense personal concerns about the innova- 
tion (low Stage 2) . 



The respondent in Fi<^ure IV. 9 has most intense Stage 4 concerns, i.e*, is 
most intensely concerned about the intact of the innoveition upon her/his students. 
The lower Stage 5 and Stage 3 concerns suggest that she/he is not very concerned 
about management cf the innovation, nor about working with others. However, the 
extremely low Stage 1 score indicates that the respondent feels that she/he knows 
all that is necessary about the innovation. There is no concern at all about ob- 
taining cuiy additional information about the innovation. 

A high Stage 5 concerns profile respondent, as illustrated in Figure IV. 10, 
is heavily concerned about working with her/his colleagues or others in coordi- 
nating use of the innovation. This concerns profile is typical of "-.earn leaders 
and many administrators who spend a great deal of their time coordinating the 
work of others. In contrast to this profile, mcLnv full-time administrators who 
have hiqh Sta^i 5 concerns tend to be lower on Stage 4. As illustrated in Figiire 
IV. 11, they do not reflect relatively intense concern^ about students. By check- 
ing the demographic page, the interpreter will knov^ whether or not the respondent 
has the role of an administrator or is a full-time teacher. Here again, inter* 
pretatitin is straightforward, with the high Stage '5 score indicating that the in- 
dividuauL has her/his most intense concerns cUbout coordination with others in rela- 
tion to the innovation. 

In general, high Stage 6 concerns profiles (Figure IV. 12) do not appt^ar to 
reflect only concerns about obtaining other ideas. High Stage 6 concerns 
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generally indicate that the respondent has other ideas about the innovation and 
is concerned about seeing the ideas put into practice, or at least tried out. 
In many cases, persons witt; high Stage. 6 concerns have ideas that would result in 
replacing or drastically altering the innovation from its present form. These 
individuals normally have relatively intense student-oriented concerns so their 
Stage 4 score may also be relatively high. In general, their Stage 0, 1, and 2 
concerns axe quite low. 

Multiple PeiUz User Profiles 

Multiple peaks are not as common as one might expect, although there are a 
few combinations that are frequently observed. One common example of multiple 
peaks is the profile with high Stage 3 and 6 concerns (Figure IV. 13). Some in- 
dividuals will have high management concerns (Stage 3) and, at the same time, 
have ideas (high Stage 6) about what to do about their management concerns. These 
individuals tend to have their management problems under control. They contrast 
sharply with the high Stage 3 individvials who are low on Stage 6. These individ- 
loals do not have ideas about what to do. If the management concerns appear to be 
insurmo^antable , the high 3, low 6 individ^.al may also have relatively high Stage 
2 concerns. Stage 2 concerns will tend to be lower w.'^h the individual who is 
high on both Stage 3 and Stage 6. 

Another common multiple peak profile is that of the highly involved, broad- 
range impact-concerned user of the innovation. Figure IV,. 14 is the concerns pro- 
file of one fxill professor who was an eacperienced* user of the innovation of in- 
structional modules and coordinator of a teacher educator program involving ten 
to 15 faculty members. The faculty members were involved in revision of the mod- 
ules to improve learning, and the professor was responsible for coordinating this 
revision, in addition to reguleu: progr^ activities. The high Stage 4, 5, and 6 
concerns reflect his concerns about these various responsibilities. 

It is interesting to note the veryaow Stage 0, 1, and 2 scores. The person 
is very involved in h-i.s work (low Stage 0) , is highly knowledgeable about mod- 
ules (low Stage 1) and is personally very comfortable (low Stage 2) . Members of 
the CBAM staff are acquainted with this particular individual and feel that this 
profile was representr ^e at the time the SoC Questionnaire was completed. 

Stage 0 Scores 

As mentioned previously, the interpretation of Stage 0 is not as straight- 
fosn^rard as the interpretation of other stage scores. The Stage 0 score has a 
significantly different meaning for users than it does for nonusers. For non- 
users of an innovation, a high score on Stage 0 is a straightforward indication 
of the degree of intensity of their concerns about the innovation. For nonusers. 
Stage 0 scores that are up in the 70th, 80th, and 90th percentiles indicate in- 
dividuals who axe intensely concerned about the innovation, while percentile 
scores that are lower, in the 50th and 40th percentiles, reflect low intensity 
concerns about the innovation. It is tlrue that arithmatically a 50th percentile 
score is average; however, for nonusers, these are relatively low scores. 

A different interpretation applies to Stage 0 scores for users of the inno- 
vation. In general. Stage 0 scores for users are low, in the 10th, 20th and 30th 
percentile range, while Stages 3 through 6 concerns will be relatively high. How- 
ever, the Stage 0 score for established users who are no longer particularly 
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concerned about the innovation begins to climb (e.g., Figure IV. 15). Experienced 
users tend to have many other things in their lives outside of the innovation 
that concern them more, and their Stage 0 score reflects this fact by being up 
i in the 60th, 70th, and perhaps even 80th percentiles. However, their Stage 1 
cmd 2 scores are relatively low and their second highest stage score is most 
likely in one of the Stages 3 through 6. Figure IV. 15 represents such a user 
who is. clearly not concerned about the innovation. 

One reason for this shifting in Stage 0 scores is found in the five individ- 
ual Stage 0 items on the SoC Questionnaire. Item 21, for example, states, "I 
am completely occupied with other things.'' Individuals who are mOi:«* experienced, 
comfortable, and confident users of the innovation tend to shift Jieir concerns 
to other aspects of their lives. They therefore report very directly that tilings 
other than the innovation are of more concern, thereby raising tn^lr Stage 0 
scorp. Other Stage 0 items are marked high by nonusers. As long as the reverse 
polarity of the interpretation of the Stage 0 score is kept in taXxid, interpreta- 
tion again is reasonably straightforward. 

Total Score 

The total score has not been referred to in any of these analyses because 
it does not have a unique meaning. Because concerns axe developmental in nature, 
individuals tend to icore high on one or two stages and low on the others. The 
Total score is usually in the same range for a person who is high on Stage 6 and 
cuiother who is high on Stage 1. It is sensitive only to more extreme response 
patterns. A person who marks many items as being of high concern has a high 
Total Score, while ^he person who marks most of the items as being of little 
concern or irrelevant has a low Total Score. 

The Total Score can be a straightforward indication of the intensity of 
concern, with either an extremely low or an extremely high Total Score, it 
could also be interpreted that, for the respondent* the items were not sortable 
according to different Stages of Concern. An alternate interpretation could be 
that the respondent had a "response bias" or te^ency to mark the it&xts at one 
extreme or the other. In any case,^ the Total Score may provide some clues for 
interpretation, but these clues should be checked out against the 3tage scores 
and the individual item responses as discussed in the next several pages. 

Individual Item Analyses 

Analyses of individual, item responses can sometimes provide further clini- 
cal insight. For exaii5>le, Figure IV. 16 illustrates three sets of individuals' 
responses to items. Several ruleS can ]je used to interpret' these responses. 

First of all, and perhaps most important, one should look at the overall 
response pattern by stage. Did the respondent ''Q-so'»'r." the items. That is, did 
the individual tend to mark all th^ items for certain ^- ^.igh and for other 

stages low? The distribution of items for the first individual in Figur ; IV. 16 
suggests that the individtial did in fact read the items carefully. Her/his re- 
sponse pattern is quite consistent. The items in Stages 0, 1, and 2 are gener- 
ally marked ^fw, while the raw score values for items on Stages 4 -and 5 are all 
marked high. This suggests that the individual dia differentiate the responses. 
One can infer from- this that attention was paid to the measure in responding. 
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Figure IV. 16. Sample Individual SoCQ Item Responses 
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In many instances, when stage scores and profiles look irregular, it is pos- 
sible to locate one or two items that were marked extremely differently from the 
general resroiise pattern. Sometimes, by doing this, it is possible to under- 
stand what was going on in the person's mind. This kind of analysis led to the 
understanding of why Stage 0 scores couli be high for both users and nonusers; 
different Stage 0 items axe marked high depending on use or nonuse. 

As illustrated in the second sec of data in Figure IVnl6, some individuals 
do not con. isttJitly sort the items. This failure to sort the items suggests 
lack of differentiation according to Stages of Concern. Perhaps the respondent 
cannot differentiate between stages because of a general confusion cibout what the 
innovation iS; or the innovation is so far removed frcxn the respondent's life 
space that it has little meaming. In the case of the second individual displayed 
in Figure IV. 16, when asked why she responded the way she did, she reported that 
she had filled out the measxire at the end of a four-day mountain rr^reat, did not 
know a great deal about the innovation at tiiat time, and was unable to sort out 
and make sense of the questionnaire. 

For the third individual in Figure IV. 16, /there is neither a clear-cut pro- 
file nor a Qrsort. However, in this case, all of the individual item responses 
are extremely hig'^ . Th*' extreme response lifendency suggests the lack of ability 
or willingijiess t differentiate between th/a sourc*2S of concerns about the innova- 
tion; it also suggests that the person maty be fairly strong-minded or extremely 
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Comparing SdCDatajt^th Demographic and Other Data 



The demogra" Ixic page attached to the SoC Questionnaire can provide data such 
as age, sex years of teaching experience, and cycles of experience with the in- 
novation. All of Lhese data can be contrasted with SoC Questionnaire data. Cross- 
tabulations and correlations of high Scages of Concern with demographic data can 
lead to further explanations and interpretations of concerns data . 

It has been of interesi- i-n us, in our research to date, that there have been 
no outstanding relationships between standard demographic veuriables and concerns 
data. Rather, as our research unfolds, there is increasing support for the hy- 
pothesis that "irfterventions" and "conditions" associated with the implementation 
effort are more critical veuriables than age, sex, teaching experience, e^c. As 
hypothesized in the Concerns-Based Adop*:ion Model. > the state of the user s^^-. ^ 
appears to be significantly more inqportant to understanding SoC than standard 
demographic variables. Identifying, dociomenting and measuring thejie procedures, 
processes and the implications of these interrelationships are the current thrusts 
of the PAEI/CBAM Project. 
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Guidelines for Interpretation of the SoC Questionnaire Data 

The following gtiidelines emphasize the interpretation of full SoC profiles 
beised on percentile scores, and are alsc useful when interpretation is limited 
to high and second high scores. The guidelir.es are abstracts of statements that 
have been discussed at length earlier in thi^ sec^-ion and are presented here in 
abbreviated form to facilitate interpretations. Divided into four parts, the 
guidelines include: 

1. Establish a Holistic Perspective ; 

2. Look at High and Low Stage Scores ; 

3. Look at Individual Item Responses; 

4. Look at the Total Score. 



1. Establish a Holistic Perspective • \ 

The goal of interpreting the SoC Questiom/aire data is the^ development of an 
overall perspective and description of^-'^Kfesxftiative intensity of the different 
Stages of Concern about a paurticular innovation for the respondent (s) . The in- 
terpreter needs to strive to develop k gestalt based on all the Stages of Conceam 
scores. In developing an interpretati^tt7--tne interpreter needs to explore alter- 
native intSL-preUatioris, <ind check them out against other parts of the SoCQ data. 
The focus for interpretation should be on what stages are high and low, and what 
the person seems to be indicating about her/his concerns. Developing this holis- 
tic description requires practice and thought. It cannot ba done mechanistical- 
ly. 

2. Look at the High and Low Stagts Scores. 

Look at the relative highs and lows for that individual, not how ^igh or 
low tlie individual is in relation to some other SoCQ data. 

Stage 0: High 0 — Indicates either an experienced user who is more 

concerned abcmt things not related to the innova- 
tion, or a ndnuser who is jus becoming aware of 
the innov2±^n. 

Low 0/high other stages — Suggests intense involvement with 
the innovation 

Low 0, 1, 2, and 3 — Indicates an experienced user who is 
\ still actively concerned about the innovation. 

Caution — If the Stage 0 percentile is particularly high 
relative to the other scores, the other stage 
scores may have little significance. If th^re is 
an overall high rejponse tendency, the high Stage 
0 score may not retiect unconcern adxDut the inno- 
vation. 

Stage 1: High 1 — Wamt more irformation aboitt the innovation. 

Low 1 — Fe-^l that they alroad" know enough about the inno- 
vation. 
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Stage 2: High 2 — Have intense personal concerns ^ut the innovation 

and its consequences for them. WMle these concerns 
reflect uneasiness regarding the innovation, they 
do not necess2u:ily indicate resistance. 

Low 2 ~ Feel no personal threat in relation to the innova- 
tion. 

Stages 1 amd 2 generally go together, but when they fall apart, 
check them closely. 

High 1/low 2 — Need more information about the innova- 
tion. These respondents are generally open to and 
interested in the innovation. 

Low 1/high 2 — Have self concerns, tend to be more nega- 
tive tow2u:d the innovation and generally not open to 
information about the innovation per se. 

Stage 3: High 3 — Have logistics, cime, and management concerns. 

Low 3 — Have minimal to no concerns about managing use of 
the innovation. 

Stage 4: High 4 — Have conc^ ens ad)Out the consequences of use for stu- 
dents. 

Low 4 — Have minirial to no concerns about the relationship 
of students to use of the innc /ation. 

Stage 5: A high 5 score is conplex; 

High 5 — Have concerns about working with others in relation 
to the innovation. A high 5 will all other stages 
being low is likely to be an administrator, coordi- 
nator, or team leader — one who perceives herself/ 
himself to be in a leadership role; coordinating 
others is the priority. 

High 5 with sane combination of 3, 4, and 6 also being high — 
Have concern about a collaborative effort in rela- 
tion to the otJier high stage concerns. 

High 5 with 1 being high ~ Have concerns about looking for 

ideas from others, reflecting more a desire to learn 
from what others know cuid are doing, rather than 
concern for collaboration. 

Stage 6: High 6 with low 1 Not interested in learning more about the 

inno/ation. The person is likely to feel that she/ 
he already knows all about it and has plenty of 
ideas . 

High 6, high 3, low 0,1, aud 2 ~ Is a user who tends to be 
positive in attitudes t^ ;ard the innovation, but 
has maiiy logistics issues to take care of. The 
high 6 indicates that the person has ideas about how 
to in5)rove use of the innovation. 
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Talling-up 6 for nonusers Has ideas about how to do things differ- 
ently and is likiely to be negative toward the innovation. 

J. looic at the Individual Item Responses. 

Look at the individual item raw score distributions, check for patterns^ 
turerids, and irregularities. Watch the flow of item scores from left to right. 
Do they increase or decrease by stages? 

A. If it appears by the raw scores at the respondent Q-sorted ac- 
cording to Ftages, more credence can be given to the profile. 

B. Lack of sorting suggests general confusion about the innovation or 
lack of a clear focus (perhaps the respondent did not read the 
items closely) . 

C. (Ibnusers do not always peak clearly on one or two stages. However, 
if the items for Stages 0, 1, and 2 are relatively high and Q-sorted 
then the respondent is likely to be a nonuser. 

D. If there are no clear peak stages, then tht person has multiple 
stages of concern or no clearly focused concerns. 

i\rote: Cur experience has suggested that some individuals whose item responses are 
constantly in the upper extremes (on th« SoCQ, this would be the use of 5's, 6'Sf 
and 7's) tand to be outspoken with definite opinions. In some cases, consistent 
use of the lo^^^r extreme item respoises suggests that the person will be unlikely 
to share her/his opinions with others. Mirny of those Mtho consistently use middle 
range item responses tend not to be forthri^^it in their opinions. Although these 
patterns have noz been specifically investigated with regard to the SoCQ, there 
are some indicatio.is that they do apply. 

4. Look at the Total Score. 

The total score ^ to some degree, reflects the amount of involvement the per- 
son has with the innovation. However, the total sco'^e should no*- be given very 
large significamce in the overall interpretation. 

A. A low total suggests low intensity of concerns and a comfortable- 
ness with the inno^' tion. 

B. A high total percentile suggests definite feelings and involvement 
with the innovation. These may be either negative or positive. 



SECTION V. 
LIMITATIONS AND RESTRICTIONS 



The most iipportant restriction regarding the SoC Questionnaire relates to 
the purpose for its use. The questionnaire was designed for and is intended to 
be used strictly for diagnostic purposes for personnel involved in the "adoption" 
of a process or product innovation. It should not be used for purposes of screen 
ing or evaluation. Concerns axe neither good nor bad, and it is inapp-ropriate 
to analyze them ir those terms. Knowing that one individual has high Stage 3 
concerns and another is high on Stage 4 does not mean that one individual is some 
how better than the other. It only means that, in relation to the innovation in 
question, the kind of assistance that would be helpful to the two persons is dif- 
ferent. 

Personality assessment cannot be accomplished with the SoC and no atteo^t 
should be m .de to do so. The instrument meetsiires the concerns of individuals 
about specific innovations. Concerns are natiiral, healthy phenomena that should 
not be equated with personaUJ^ty characteristics. , 

It may be teaqpting to modify one or more of the questionnaire items to bet- 
ter address a particular situation or need. Do not succumb to this temptation. 
Even the slightest modification of the soC could result in invalidation of the 
scoring and norming standards and ultimately to misinterpretation of the resxilts. 
The Research and Development Center assumes no responsibility for the reliability 
or validity of the measure if any of the 35 questionnaire items aure altered in 
any way. 

The standardization sample for the SoCQ consisted of adults serving as 
teachers or administrators in educational institutions, grades kindergarten 
through higher education. Utilization of the SoC with younger age groups or with 
other occiipational groups is not warran\:ed. 

Interpretation of the data can only be as good as the respondent was con- 
scientious in convicting the Soc^ and the interpreter is in developing hypothe- 
ses. As noted in earlier sections, interpretations should be treated as hypothe- 
ses and confirmed w^.th the respondents rather than accepted as fact. 

^ The items are known to work with nonusers of an innovation and with highly 
experienced "old hands." Depending on their frame of reference, individuals 
often will identify specific SoCQ items that are not appropriate for them, or 
the/ will point out that the "ixmovation" is really not new for thepi and that 
they do not think of it as an innovation. Gratefully accept their feedback; it 
has been our experience that their responses will still be appropriate and re- 
flect their concerns. 

A final note about data analyses. We expoct some adventurous souls will 
^ take it upon themselves to devise a ''better" scoring system for the SoCQ. We 
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welcome improvements. However, be advi^ id eibout what the measure was developed 
to do* If a measure is needed for some other purpose, then make the effort to 
develop a new measure that is designed to meet that purpose. And most important- 
ly, the SoCQ should not be administered to a small saii5)le of innovation users 
and a factor analysis performed on their data. The results will most assuredly 
be factors that load the items heavily on one or two of the present SoC stages 
and that do not distinguish the other stages. A large stratified sample of both 
users and nonusers is required if a factor analytic approach is to be meaningful. 
For example, it is highly unlikely that a sample of first-year users of an inno- 
vation will include individuals that represent intense concerns for each of the 
seven stages. 

With consideration of these limitations aind restrictions, it is highly likely 
that the SoC Questionnaire will provide valuable data to those interested in re- 
seetrching and facilitating change. Problems and questions should be addressed to 
the authors of this manual. 
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i^UViCU ly/b AA SAMPLE INTRODUCTORY PAGE 



NHS 

SOCQ20 

Teaming 



Concerns Questionnaire 



Hame (Optional) 
Date Completed 



It is very in^rtant for continuity in processing this data that we have a 
unique number that you can remember » Please use: 



Last 4 digits SS# 



The purpose of this questionnaire is to determine what people who are using or 
thinking about using various programs are concerned about at vaurious times during 
the innovation adoption process. The items were developed from typical responses 
of sd "ol and college teachers who ranged from no knowledge at all about various 
innovations to many yeaxa e3q>erience in using them. Therefore, a good paurt of the 
items may appeair to be of little relevcuice or irrelevant to you at this time . For 
the ccoqpletely irrelevant items, please circle "0" on the scale. Other items will 
represent those concerns you do have, in varying degrees of intensity, and should 
be marked higher on the scale, according to the explanation at the top of each of 
the following pages. 

For exanqple: 

0 1 2 3 4 5 6 ^) This statement is very true of me at this time. 

0 12 3 5 6 7 This statement is somewhat true of me now. 

0 2 3 4 5 6 7 This statement is not at all true of me at this time. 

^) 1 2 3 4 5 6 7 Thi*=' statement seems irrelevant to me. 

Please respond to the items in terms of your present concerns , or how you feel 
about your involvement or potential involvement with TEAMIN G. We do not hold to 
any one definition of this innovation, so please think of ic in terms of your own 
perception of what it involves. Since this questionnaire is used for a variety of 
innovationa, the name TEAMING never appears. However, phrases such as "the innova- 
tion,** "this approach," axid "the new system" all refer to TEAMI!^ . Remember to re- 
spond to each item in terms of your present concerns about your involvement or 
potential involvement with TEAMING . 

Thank you for tadcing time to coirplete this task. 



Copyright, 1974 
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A.2 SoC QUESTIONNAIRE ITEMS 



0 1 2 3 4 5'6 7 

Not true of me now Somewhat true of me now Very true' of jne now 



)f^me 




01234567 lam concerned about studcmts' attitudes toward this in- 

novation. 

01234567 I now Jcnow of some other approaches that might work better. 

01234567 I don't even know what the innovation is. 

01 2 34567 lam roncemed aJDout not having enough time to organize 

myself each day. 

> 

01234567 I would like to help other faculty in their us6 of the in- 

novation. 

3 4 5 6 7 I have a very limited knowledge about the innovation. 

3 4 5 6 7 I would like to know the effect of reorganization on ray 

professional status. 

3 4 5 6 7 1 am concerned aUDout conflict between my interests and my 

responsibilities • 

3 4 5 6 7 I am concerned about revisiiig my use of the innovation. 

01234567 I would like to develop working relationships with ooth 

our faculty and outside faculty using this innovation. 

01234567 lam concerned eibout how the innovation alffects students. 

01234567 lam not concerned about this innovation. 

^01234567 I would like to know who will make the decisions in the 

new systeu. 

px23 1 567 I would like to discuss the possibility of using the inno- 

vation. 

01234567 I would like to know what resources are available if we 

\ deride to adopt this innovation. 

01234567 1 am concerned aJDout my inadsility to meUiage all the inno- 

vation requi^s. 

01234567 I would like to know how my teaching or administration is 

supposed to change. 

01234567 I would like to famixieurize other departments or persons 

with the progress of this new approach. 
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01234567 
Mot true of !ne now Somewhat true of me now Very true of me now 

01'?34567 lam concerned about evaluating my impact on students. 

01234567 I would like to revise the innovation's instructional ap- 

proach • ' 

01234567 Icun completely occupied with other things. 

01234567 I would like to modify our use of the innovation based on 

the experi^mces of our students. j 

Ol23456r'7 Although I don • t know about this innovation , I am concerned ^ 

about things in the area. 

01234567 I would like to excite my students about their part in this 

approach . 

.01234567 I am conpemed about time spent working with nonacademic 

problems related to this innovation. 

0123 4 567 I would like to know what the use of the innovation will* 

require in the immediate future. 

0.1234567 I would like to coordinate my effort with others to maxi- 

mize the innovation's effects. 



4 



Si 



0123M567 I would like to have more information on time and energy 

ccmmitments required by this innovation. 

01234567 I would l">ke to know what other faculty are doing in thi's 

area. # - 

0123456 7 At this time, I am not interested in learning about this 

innovation. 

01234567 I Would like to determine how to supplement, enhance Ojj 

replace the innovation. 

01234567 I would like to use feedback from students to change the 

" program. 

01234567 I would like to know how my role will change when I am 

using the innovation. 

03 2 3 4567 Coordination^ of tasks and people is taking too much of my 

• time. 

0 1234567 I would like to know how this innovation is better than 

what we have now. 
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PLEASE V:OMPLETE :E FOLLOWING: 

1. What percent of your job is: 
teaching % administration 



2. 
3. 
4. 



6. 
8. 
9, 



11. 



12. 



13, 



Do you work: full time 

Female Male 

Age» ' 20-29 ' 30-39 



^% other (specify) 
part time 



40-49 



50-59 



60-69 



Highest degree earned: 

Associate Bachelor 

Year degree earned: 



Masters , 



Doctorate 



Total years teaching: 



Number of " ^ars at present school : 



In how many sciiools have you held full time appointments? 
one tw three four five or more 



10. How loTvq have you been involved in teaming, not counting this year? 



never 



1 

ye2u: 



2 

years 



1 

years 



4 

yeeurs 



5 years 
or more 



In your use of teaming, do you consider yourself to be a: 
nonus^ novice intermediate old hand ^ 



pi»st user 



Have you received formal tradning in teaming (workshops, courses)? 
yes no 

Are you currently in the first or second year of use of some major innovation 
or program other than teaming? 



yes 



no 



If yes, please describe briefly. 




14. Pleeise check to see that you have written the last four digits ot your Social 
Security number on the front page of this questionnaire. Thank ycu for your 
help. 
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TiM BM< qi ch ond Dttv»lopmeiit Cantor for Teocher Education 

IJ ni versity of Texas Austi n 7871 2 



Novecvber 10, 1976 



Dear Teacher: 

Thafnk you for your willingness to assist us in one of our research efforts. 
We are currently involved in studying the process of chcuige in education, 
what happens to individuals involved in change and why. Because your school 
is working with several innovative proarams, we feel you are one of the best 
sources of information for us as we seek to ieaxn more about the process of 
change. At this time, the program we would like to focus on is teaming. 

We are asking you to fill out the at ached questionnaire which seeks to 
measure your present concerns ah'^ut teaming. Please place the completed 
questionnaire in the envelope included and hand it in to the office. They 
will then be sent to us. As you will notice, we do not ask for your name, 
but we would like a number to use in ovx data processing. We ask that you 
use the last four numbers of your Social Security number for this. 

Thank you for your help. We will be cert?in to report our findings to you 
in the hope that they will be of value in your teaching. 



Sincerely, 




Gene E. Hall, Project Director 
Procedures for Adopting Educational 
Innovations/CBAM Project 



GEH/sh 



Attachments 
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C.I INSTRUCTIONS FOR USING FORTRAN PROGRAM TO SCORE SoCQ'S 



Program XSCORE 

App .idix C contains a listing of the computer program used to score the SoCQ. 
The program was written in ANSI Standard FORTRAN, and has been successfully run 
on several computers with very minor modifications. This program generated the 
^w Score lables and Group Reports which are scattered throughout the manxial. 
Other exanxp.es of the output can be seen in Appendix C.3 following the program. 

The program vas written using "Tape 1" as input and "Tape 3" as output. 
Some installations may have logical unit numbers which specify the input and out- 
put ievices. in such cases, the logical unit numbers would be sizbstituted into 

READ and WRITE statements in the program. For instance, if youx computer ac- 
cesses a C9xd reader designated as logiceLL unit number 5 and a line printer de- 
signated as logical unit number 6, then ••READ(1,10) " should be "READ(5,10) and 
WT»ITE(3,20)" should be "WRITE (6,20) /' 

The program expects a ceurcj-iroage record on the input file which contains at 
least four cards: a title card, a format card, an option cstrd, and a group header 
card. 

The title card should be used to label the output according to the circum- 
stances of the SoCQ administration (e.g., "spring inservice workshop, third grade 
teachers, pre-assessment") . The contents of the entire title cetrd, columns 1 
through 60, will appear on the first page of the output only. 

The format card must contain a valid FORTRAN format specification (e<.g., 
" (2A5,13X,35I1)* ) . Ttie program expects two five-character alpha fields to be 
specified in this format and also 35 integer fields. The first two alpha fields 
should be used for identification (ID) purposes (name or number of the person who 
provided the SoCQ responses). The 35 integer, fields must contain the 35 responses 
to the SoCQ/ valid responses being the numbero 0 through 7. The format is thus 
"variable" and the punching of the SoCQ data can be modified to suit the needs of 
various processing requirements. The data cards may contain information besides 
the ID ar.d SoCQ data, but this program should not be expected to process such 
data. 

The option card specifies whether or not a Raw Table is to be printed out 
for each individual vdiose data is processed. If such a tables is desired, the 
five letters "TABLE" must be punched into card columns (CC) 1 through 5 on this 
card. If CCi-5 aure clank or contain any ether information, the Raw Tables will 
not be output. We suggest using the rest of the option card, CC6-80, for any 
information tne user would like to have printed near the top of every page of the 
entire output, ^.xich as the date of the computer run or data collection. 

The group header card contains the number of individual SoCQ's in the c,roup 
and any information the usez wishes to have printed on each page of output which 
contains data from that group. Th^ number must be right justified in CC 1 through 
5, since the program uaes this number to determine how many SoCQ's are to be pro- 
cessed. When that number of SoCQ's have been processed, tlie prograri expects to 
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find euiother group header card on the input record and reads CCl-5 of that caird. 
If CCl-5 are blank or contain only zeros, the projrain stops. If CCl-5 contain 
a number # another group is processed. Thus, multiple groups may be processed by 
preceding each group with an appropriate group b^^^er card. A blank card should 
follow the last card in the last group. 

A typical card deck for a batch processing system would be as follows: 

< System Control Cards > 
£nd of Record 

< FORTRAN Program > 
End of Record 

< Title Card > 

< Format Card > 

< Option Card > 

< Group Header Caurd 

" SoCp 
data 
_ cards 

< Group Header Card > 

" SoCQ 
data 
cards 

< hi' -^^ caurd > 
Eni-- c»t Record 
End of File 

An exan^le of the program control cairds is included in this appendix immedi- 
ately following the FORTRAN listing. We strongly recommend that anyone implement- 
ing the program use at least this set of data to test the program. The output 
should appeau: exactly as shown on the following pages. Be especially careful to 
check that the percentiles provided by your implementation agree with those sho'vn 
here. 
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C-2 LISTING OF FORTRAN COMPUTER PROGRAM, WITH TEST DATA 



P«06RAM XSCOHE (TAPC3, OUTPUT , PUNCHr TAPE 1) 



PROGRAM xaCURE CCNERATF3 A GROUP REPORT *#ITH OPTIONAL R*N 8CC»E 
fASLES TOP tACH IhOIVlOUAL 

INPUT FILE! TAPE! (LOGICAL UNIT n 
OUTPUT FILE* TAPE3 (LOGICAL UNIT 3) 

TAPEl COnTAXnSi 

CArtO I... TITLE CARD (COLUWWS I-a«1 

CARD 2...roRMAr CARD E.G^ (2a5, I3X,35in 

CARQ 3...UPTI0N CARD 

CC 1-5 PRINT •TA8LE« FOR iHOIVtOUAL RA*< SCORE TABLE 

LEAVE dLANK FOR GROUP REPORT ONLY 

CC 6«60 OATE ANO RE^ARKSf E.G., DATE s JUL 76 

CAHO a..«bf90UP HEADER CARD 

CC fS NUHSfR OF SUBJECTS (MAXtlS0> 
RiGhT JUSTIFIED, ElG'., Z^xSd 
CC 6-40 SUSTITLE FOR GROUP 

MULTIPLE GRUUPS CAN 8E PROCESSED BY PRECEOI/^G EACH CROUP **VH 
AN APPROPRIATE GROUP HFADER CARD. 

NOTEJ A BLANK CARD MUST FOLLOW THE LAST OATA GROUP FOR SINGLE 
OR MULTIPLE GROUPS'. 

ONLY ONE TITLE JARO, DATA FORHAT CARD AND OPTION CONTROL CARD CAN 
4£ USED nlJn SINGLE 0^ MULTIPLE GROUPS. 



COPYRIGHT, 1977 
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OIhEnSIOn IPR0F(J5C, 10), IT(71# KEY(35), IK(5#7) 
QlHENSlUN ITlfLEdbli ISCALE (36, 7) # IT0T(35#2J# 
ai^ENSlUN IY(35)# I0(2)# NDATCCIS) 



, NT{J5)^ KF(16) 
X(8), 8(8), IX:35} 



OATA ISCALE/I0#23#29f37#46,53#60,66#7?,77,81,84# 
•96 >97» 98, 98^99, 99^99, 99,99,99,99,99, 99, 99,99,99, 
•23» 27, 31', 34, 37, 40, 43, 45, 48^51, 54, ^7, 60, 63, 66, 69, 
•91,93,95,96,97,98,99,99,99,99,1^5,12, 14,17,21,25, 
•4a,52#5l,57,59,o3,67,70,72,76,73,80,83,d5#d7#a9, 
•97, 99, 02, 05,07,09,11,15,18, £3, 27, 30, 34, 39, 43, 47, 
•77, 80, 83, 85, »«, 90, 92, 94, 95, 97, 97, 98, 98, 99, 99, 99, 
•03,04,05,05,07,00^09,11, 13, 16, 19, 21, 2a, 27, 30, 33# 
•66, 7t » 76, 82, 06, 90, 92, 96,01/ 02, 03, 03# 04, 05f 07, 09, 
•i5#26, 31, 36,40,44, 48,52,55,59, 64, 68, 72, 76, 80, 84, 
*0i»02#0i,05,06,09, 11, 14, 17,20,22,26,30, 34,38,4:, 
•73#T' ,81,8a,87,?0#92,94,96,97,98,99,99,99/ 

OATA ITUT/l,42,55,o0<r66,72,7a,78,80,d7,S6,89,92, 
•1.0f U2#lt4,118,t22#l2S,127,132, i36, 141 , 144, 1S0, 



86,89,91, 
99,99,05, 
72,75,80, 
26,31,35, 
91,92,94, 
52,56,60, 
0tf6l,01, 
36,43,48, 
10*12,14, 
66,<ri,93, 
47,52,57, 



93,94,95 
12,16, 19 
64,86,90 
39,41,45 
95,96,96 
65,69,73 
ei2,02,03 
54,59,63 
16,19,22 
95,97,98 
60,65,69 



"^S^^B, 101,104,107, 
156,161, 173^189, 24 



20 

2 

2 

23 
24 
25 
26 
27 
28 
29 
30 
31 
32 
33 
34 
35 
36 
37 
38 
39 

41 
42 
43 
44 
45 
46 
47 
48 
49 
50 
51 
52 
53 
54 
55 
56 
57 
56 
59 
60 
61 
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*#69,7l#/4,77,80,e3,a6#d9,92,95#98,99/ 

DATA KET/3#12f21#23#38rO#l<»#i^#26,3S#7r 13#17r28#33»4,8a6i25o4rl# 
«ll#19,24.32»Sa0ria#27,29,2,9,20«22#3i/ 

DATA ITA8LE/5HTABLE/ 

DATA IBLANK/5H / 

DATA MZtRO/geaes/ 



At/kO (1#10) iri7lE,XF 
10 FORMAT CloAS/i6AS) 

^^ITC (3,20^ 
20 FORMAT llHil 

^HITE (3,30> ITITUriKF 
30 FORNAT U,i6AS/X,l6A5) 

READ (1^401 LC#NOATC 
48 FORMAT US,1SA5) 

IF (UC.tQ.ITAaLE) -tRITE (3#5fl> 
50 FORHAT U,3bHRAI« TAOLf ANO CROUP REPORT RCOUCSTEO) 

If CLC.i^E;iTA6LE) mRlJt {3f6idl 
60 FORMAT ix,17H6R0UP REPORT ONLY) 

-RITE (3,70^ ^*OATE 
70 FORMAT (/SlX^iSAS) 

NCa0 

ZCNTsi 
30 REAO (lr901 H$,HJ 
90 FORMAT U5,;5A51 

If (NS.bQ«N2ER01 GO TO 1^0 



00 150 IR«l,Md 

READ (1,KF) X0(l)»t0(2)#lX 

C COOE FOR GENERATING ^AN TABLE DATA 
C 

00 100 ISU3S 
J«KEY(n 

iT(n«ix(j) 

109 CONTINUE 

} 00 110 r*if7 

00 110 J«1»S 

tt0 CONTINUE 

00 120 Jsi,7 

00 120 I«1,S 

n(J1«tK(I,J) + ITCJ1 
120 CONTINUE 
LTOT«0 

00 iJ0 :3i,7 

130 LTuT»LTOT*XT(I) 

C 

C End of raw table GENCftATION 

IF (LC;EQ«ITA81£) call RA«TA8 ( IK, IT# I0,LT0T# ICNT ,NT ,nOATE) 
CAUL CENT (IT,LrOr,XSCALE,:TOT#LC) 
00 140 K«l,7 

I»^ROF(IR,K)«lT(K) 
140 CONTINUE 

IPR0^(IR#8)aiLT0T 
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IPROf (IRf9)«lO(|1 A 124 

IPR0?(IR,ri)«IO(21 A 125 

IF (Cc«NE«ITA8LE) GO TO A 126 

ICMT»ICNTfl V A U7 

IF (lR;fC.N5:0R;iCNT;EQ*4) CAUt UREOIT (ICMT) A 120 

159 CONTlNue 121 
CAUL RC^ORT (M9,XPR0F,NT#N0ArE^ A 13S 
ICNTat ' A 131 
90 TO 8tf A 132 

160 CONTlNUt A 13? 
C ' A 134 

ENO A 135 

SUdROUriNE REPORT IPROF^NT^NOATE) B i 

OINENSIUN IX(7), I0(2)# IRROF(150f 10)# Nr(t5)f NOATECiS) 8 2 

OlME^tSIUN XCa), S(8)f 58(8), KX(8), KS(8) 8 3 

ICMr«0 8 4 

NP«1 8 5 

MSL«M8 8 6 

10 COMTlNUt 8 7 

MRITE (3,20) NP 8 8 

20 FORMAT ilHl, 50X,4HPA6Ef li) 8 9 

vtRITE (3,301 NT 8 10 

30 FORMAT (/X,15A51 8 11 

•iRITE C3.a«l NOATE 9 12 

as FORHAT (/5lxa5A5) 8 13 

rtftiTE (3,50) 8 14 

50 FORHAT (/X,7HSU6JECT,9X,34H8TAGE OF CONCERN PERCENTILE SC0RES/X,6H 8 IS 

tNUN8ER#^X,lH0,SX,lHl#5X#in2,5X,lH3f5X,lH4#SX,lH5#5X,lH6,5X,SHTQTAL 6 16 

2/) ' 8 17 

Il^ICNT^l 8 18 

NL«40 8 

IF (N8L-LT.40) NL«n8L 0 20 

INsNLtlCNT 8 21 

00 80 1*11, IN 8 22 

LT0Tsi^R0F(I,8) 8 23 

I0(lT«IPH0F(I,9) 8 24 

:O(2)«IPROF(I,10) 8 25 

OC 6tf Jst,7 8 26 

I*<J)«fPROF(I#J) 8 27 

60 CONTINUE 8 28 

MRITE (3#70) 10(1), I0(2},IX,Lr0T 8 29 

70 FORMAT ^X,2A5r3X,7(13,iX),2X,I3) 0 30 

80 CONTINUE a 31 

L8a48«NL 8 32 

NSL«N8L*NL 0 33 

IF (N8L.6T;0) go to 140 8 34 

00 90 I«i,8 8 35 

iC8(lfa0 8 36 

*<X(II«0 . ' 8 37 

X(n«0.0 ^ 8 38 

3(1)^0.0 8 39 

S8(lTa0;0 0 40 

40 CONTINUE 0 41 

00 110 ^aUNS 0 42 

00 100 N«l,d 8 43 

x{n)sIPROF(J,N) 8 44 

9(Nl«S(N)fX(^0 8 45 

85(N)a8S(N)>}((N)««2 0 46 

100 CONTINUE 8 47 

U0 CONTINUE 8 48 

8N«N8 8 49 

00 120 ^<1#8 0 59 
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S ( J) 'SORT (SS ( J) /SH-X ( J) ««2) 

KX(jI«x(j)*»;5 

120 CONTlNUt 

mRITE (ifli8) NT^NS^KX^KS 
130 FORMAT (/X,1SA(S//20X,17H6ROUR PRjriL£ Ns, I3//X# 4HHEAN,6X, 7 (3X, 13} 
If SXf I3/X>7HST0 0EVf3X,7i3X,X3)f5X,23) 

L9BLS-7 
140 NRsNPtl 

iCNfBlCWTtNL 

00 160 IbWLS 
««RITE (3M50> 
150 FORHAT IXH y 
160 CONTINUE 

-•RITE (3,170) 

170 FOR^^At (2Xf35HRR0CC0UReS FOR AOOFTING COUCAT lONAL* 20H INNOVATIONS 
lFR0JECT/3X,2aHRES£ARCH ANO OCVeLOF^CNT, 29H CEf^TER FOR TEACHER EOUC 
2ATI0N/13X,33HTHE UNIVERSITY OF TEXAS AT AUSTI^^) 

IF (NSL«EQ,0) RETURN 

GO TO 10 



ENO 

SUBROUTINE CENT (Xr^CTOT#ISCALErITOT#UC) 
OIHENSIUN IT(7), ISCALE Ci6, 7) » IT0T(35r2) 
OATA ITA8LE/5hTAF ,£/ 

LT»UTOT , 

00 10 I«t#7 ' 

J»IT(ntl 
10 Xr(I)3l9cALE(J,I) 
00 20 K*lf3S 

LlslfOT(K,l) 

IF (LT;LE;Ln go to 30 C 10 

20 CONTINUE C II 

30 LTsIT0TlK,2) C 12 

IF (Lr«NE;iTAaLE) return c i: 

»«RITE (3,40> ITrLT C ii 

40 FORNAT (llXr0(I2,4XUl0HR£RCENTItE/) C 1< 

LTOT»LT C a 

RETURN C i'i 

II 

ENO C 1^ 

SUBROUTINE RaimTAS ( IK, IT^ 10^ LTf XCNT^ NTf NOATCl 0 1 

OXHENStUN IX(3S), IK(5,7), XT(7), XY(iS), 10(2), NT(15), N0ATCC15J 0 

IF (ICNr«EQ;U MRITE (3fl0) NT 0 

10 FORMAT UniflSA^) D 

IF (iCNr;EQ;i) write (3*20) noate d 

20 FORMAT t/5lXrl5AS/) 0 

nRITE (3,30) 10(1), I0C2) 0 
30 FORHAT (///9XrlSf RAM SCORES FOR ,2AS//X,6HSTAGESf 5X, lhO,5X^ IHl , 0 

1 SX,lH2rSX,lH3,5''*lH0,5X,lHS,SX,lH6/) 0 

uRITE (3,40) (rX. < JrI).Isl,7),jBl,S) 0 

40 FORMAT (4(10X,7(I3,3X.> lrl0X,7(Iir3X)) 0 

<«RITE (3,50) 0 

50 FORMAT il0X,7(3H-»^,iX)) 0 

|«RITE (3,60) IT^LT 0 

60 FORMAT il0XrS(I3#:»X)^X^9HRAW TOTAL/) 0 

RETURN 0 

0 

END 0 

SUBROUTXnC CREOIT aCNT) E 

NL«(ICNr-n*l7t7 E 



U 
11 
12 
13 
la 
I! 

a 

a 
I 

2 
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00 20 I'lrLS £ 4 

^Rirt (3#1(4) E S 

10 FORMAT \{h ^ £ 6 

20 CONTlNUt E 7 

mRITE (^,30) E 6 

ICNTaj E ^ 

30 FOflHAT (2X#i5HP90C£lURES TOR AOOPTINC EOUCAriONAt«20H INNOVATIONS £ 40 

IPR0JECT/3X#?4HRESEARCH ANO 0rVEL0PHCNT#29H CENTER FOR TEACHER EOUC £ \i 

2ATI0N/l3Xr33HrHE UNIVERSITY OF TEXAS AT AUSTIN) £ IZ 

RETURN E 13 

£ 14 

END E 15 



••ENO-QF-RECOHO.. 



TEST OATA 
(2A5»35in 
TAdL£ 
00007 
TEST 1 
2 
3 
4 
5 
b 
7 



FQrt XSCORE 



TEST 
TEST 
TEST 
TEST 
TEST 
TEST 
00003 
TEST S 
TEST 9 
TEST 10 



DATE « 14 OEC 1976 
GROUP Op 7 TEST CASES 

4603Si23654O2 113254606443 1525064231 
50 I<«6234065l3224365010l5426i6 105342 
<»t2^0345i0624335406l21265304Q2164S3 
a23t»14S6210354a65102i230o4 151320564 
I34d25o03214655062l3434 105262431605 
24 5 i 360 1 4325066 1 03245452 1 63035420 1 6 
356240l2543610ewl43565c32r4l4653i20 
GROUP UP 3 TEST CASfS 

1 1 1 1 1 i 122222223333^^. 444445555559 
0l2^0t230t 23012301230 .30123012^012 
45674567456745674567456''456745674S6 
0LANK CARD 
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C.3 OUTPUT FROM TEST RUN 



TEST DATA FQH XSCORC 
(2A5,35I1) 

9AM TAdUE ANO CROUP R£PQRr RCQUESTCO 



DATE » 14 3ec 1076 



93 

ERIC 



CROUP Of 7 TEST CAiES 
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DATE « 14 DEC 1976 



' STAGES 



RAi< SCORES FOR SUBJECT NUHBER TEST 1 



0 


1 


2 


3 


4 


5 


6 


0 


1 


2 


3 


4 


5 


6 


0 


1 


2 


3 


i| 


5 


6 


0 


\ 


2 


3 


4 


5 


6 


0 


i 


2 


3 


4 


5 


6 


0 


\ 


2 




4 


5 


6 
















0 


5 


10 


15 ' 


20 


25 


38 


10 


27 


41 


56 


30 


6a 


96 



105 
5i 



RAN TOTAC 
PERCERTIUE 



STAGES 



RAn SCORES FOR SUBJECT su^'SEH TEST 2 





1 


2 


3 


4 


5 


6 


1 


2 


3 


4 


5 


6 


i 


1 


2 


3 


4 


5 


6 


0 


1 


2 


3 


4 


5 


6 


0 


1 


2 


3 


4 


5 


6 


a 


1 


2 


3 


4 


5 


6 


0 






mmm 










5 


10 


15 


20 


25 


30 


0 


53 


43 


57 


77 


54 


as 


i 



105 
51 



RAM TOTac 
PERCENTILE 



RA(» SCORES FOR SUBJECT NUMBER TEST 3 



STAGES 



0 


1 


2 


3 


4 


5 


2 


3 


4 


5 


6 


0 


2 


3 


4 


5 


6 


0 


2 


3 


4 


5 


6 


0 


2 


3 


4 


5 


6 


0 


2 


3 


4 


5 


6 


0 














10 


15 


20 


25 


30 


0 


at 


57 


72 


90 


76 


1 



105 

•^1 



RAM TOTAL 
PERCENTILE 
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OF 7 JCSr CA3ES 

DATE s U OCC 1976 



RAM SCOPES 


FOR SUBJECT 


NUM'iER 


TfTT 


4 






STAGES 0 


I 


2 


3 


4 


s 


4 






3 


4 


5 


t 


0 


1 


2 






3 


4 


9 


6 


0 


I 


2 






3 


4 


9 


6 


0 


I 


2 






3 


4 


9 


b 


0 


I 


2 






3 


4 


9 


6 


0 


1 


2 






' • 'Is 


20 


25 


30 


0 


5 


10 


10S 


RAlp TOTAL 


93 


72 


as 


97 


1 


S 


22 


51 


PERCENTILE 



STAGES 



RAM SCORES 


FOR SUBJECT 


NUMBER 


TEST 


5 










0 


i 


2 


3 


4 


5 


6 












5 


b 


0 


I 


2 












4 


S 




0 


I 


2 












4 


5 


6 


0 


i 


2 












• 


S 


6 


ft 


I 


2 












4 


5 


6 


m 


I 


2 
















•••• 




mm 4» 




mm m 










20 


25 


30 


0 


5 


10 


IS 


IflS 


^QT.Ai 






98 


, 90 


94 


2 


3 


14 


42 


51 


PERCENTILE 







STAGES 



i 



RAM SCORED 


FOR SUBJECT 


NUM6ER 


TEfV 


6 


0 


1 


2 


I 


4 


5 


6 


S 


^ 


0 


1 


2 


3 


4 


5 


6 


0 


I 


2 


3 


4 


S 


6 


0 


1 


2 


3 


4 


* 5 


6 


0 


1 


2 


3 


4 


5 




0 


1 


2 


3 


• 4 












mmm 




25 


30 


0 


5 


10 


15 


20 


99 


97 


5 


-15 


X 7 


24 


65 



105 

65 -JU 



( 



S'ROCEOURES FUR AOOFTInC EDUCATIONAL INNOVATIONS RRO/ECT 
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I T«E UNIVERSITT OF TEXAS AT AUSTIN 



flAif TOTAL 
PERCENTlLt 
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4 



97 



GROUP OF 7 TEST CASES 



RAW SC0«3 FOft nuBJtCT NU^^C £» TEST 7 



sTAaes 8 


4 


2 


3 


4 


> 


6 






h 


8 




Z 


3 


4 








6 


8 




2 


3 


4 








b 


0 




Z 


3 


4 








6 


0 




z 


3 


4 








6 


9 




7 


3 


a 








WW 

38 


8 


5 


Id 


:5 


28 


25 


i85 




^9 




2«J 


34 


16 


46 


44 


51 





/ 



fr uNrvffusiTT OF fr»*3 *f »wsti^i 



ERIC 



9G 



PAGE I 

6R0UP OF 7 CASeS 

OATE ■ la OCC 1976 

SU64eCT STA6& Qf CONCERN PERCENTILE SCORED 



NUHeER 


i 


1 


2 


3 


4 


5 




TOTAL 


TEST t 


10 


27 


41 


56 


30 


68 


96 


51 


TEST 2 


S3 


43 


57 


77 


54 


88 


1 


51 


TEST 3 


6i 


57 


72 


90 


76 


1 ~ 


9 


51 


TEST 4 


93 


72 


as 


97 


1 


5 


22 


51 


TEST 5 


98 


90 


94 


2 


3 


14 


42 


51 


TEST 6 


99 


97 


5 


15 


7 


28 


65 


51 


TEST 7 


99 


5 


25 


34 


16 


48 


64 


51 


fiROUP OF 


7 TEST 


CASES 


















GROUP 


PROFILE N« 


7 








NEAN 


76 


56 - 


5^ 


53 


27 


36 


46 


51 


sTo 


31 


31 


30 


34 


26 


31 


34 


8 
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6R0UF or 3 TEST CASES 
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OATE 9 14 OEC 1976 



RAM SCOflCS FOR SUBJECT NUMdCR TEST 8 





0 


1 


2 


3 




■ 








1 


1 


1 


1 


1 


1 


i 








2 


2 


2 


2 


2 


2 






3 


3 


3 


3 


3 


3 


3 






4 


4 


4 


4 


4 


4 


4 






f 


5 


5 


5 


5 


5 


5 
























15 


15 


15 


15 


15 


IS 


15 


105 




93 


57 


57 


56 


16 


28 


42 


5i 




RAi« SCORES 


FOR SUdJCCT 


MUMHCR 

n 9 


TEST' 








0 


I 


2 


3 


4 


5 








2 


1 


2 


3 


0 


0 


1 






3 


I 


0 


3 


2 


1 


0 






0 


2 


0 


3 


2 


1 


3 






2 


1 


3 


0 


3 


2 


1 






1 


2 


0 


1 


3 


0 


2 
























8 


7 


5 


10 


10 


4 


7 


51 




7Z 


34 


25 


34 


7 


4 


14 


6 




RAM SCORCS 


FOR SUBJECT 


NUHRER 


TEST 


10 ^ 




STAGES 


0 


1 


2 


3 


4 


5 


6 






6 


5 


b 


7 


4 


4 


5 






7 


S 


4 


7 


6 


5 


4 






4 


6 


4 


7 


6 


5 


7 






6 


5 


7 


4 


7 


6 


5 






5 


6 


4 


5 


7 


4 


6 
























28 


*27 


25 


30 


30 


24 


27 


191 




99 


93 


85 


97 


76 


64 


90 


99 



RAM TOTAL 
PERCENTILE 



RAN TOTAL 
PERCENTILE 



RAN TOTAL 
PERCENTILE 
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PAGE \ 



GHOUP Of 3 TEST CASES 

DATE 



SUBJECT 


STAGE Of 


CONCERN 


PERCENTILE 


SCORES 




TOTAL 




9 


1 


2 


3 


4 


5 


6 


TEST 8 . 


93 


57 


57 


56 


16 


28 


42 


51 


TEST 9 ^ 


72 


34 


25 


34 


7 


4 


14 


6 


TEST 10 


99 


93 


85. 


97 


76 


64 


90 


99 


GROUP OF 


3 TEST 


CASES 


















GROUP 


PROFILE 




3 








MEAN 


88 


6i 


56 


62 


33 


32 


49 


52 


STD OEV 


12 


24 


25 


2b 


31 


?.5 


31 


38 
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APPENDIX 0 
GRAPH FOR PLOTTING SoC PROHLE SCi)RES 
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RELATIVE INTENSITY 



IN) 

o 



o 



CO 

o 
o 

CO 

o 
m 



^ 01 



s 















— i — ■ 


1 ; 


1 r • • • " 


: — 1 — , 


: — 1 — ^ 


. INFORMATIONAL 


— 1 — : 


1 \ 


: — 1 — ' 


: — 1 — ' 


: — 1 — : 


• PERSONAL 


1 ; 


, — 1 — : 


' — 1 — ' 


: — 1 — 


: — 1 — 


- MANAGEMENT 


— 1 — 


; 1 


: — 1 — 


: — 1 — 


: — 1 — 


' CONSEQUENCE 


— 1 — 


: — 1 — 


: — 1 — 


: — 1 — 


: — 1 — 


• COLLABORATION 
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